Skip to content

FlashAttention build skip when bos has cache #69961

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Dec 6, 2024

Conversation

GuoxiaWang
Copy link
Contributor

@GuoxiaWang GuoxiaWang commented Dec 4, 2024

PR Category

Performance Optimization

PR Types

Performance

Description

Pcard-70459

优化 FA 编译,当 bos 上有 cache 时,不进行实际的编译,而是从 bos 上直接拉编译好的 so

打包 cache 方法:

1、进入到 third_party/flashattn 目录中获取 gitcommit
2、创建 flashattn_libs_*gitcommit* 文件夹
3、创建 fa_libs 文件夹,然后将编译完成的 so build/third_party/install/flashattn/lib/lib*.so 拷贝进去。
4、执行打包操作 tar -cf fa_libs.tar fa_libs
5、执行md5sum fa_libs.tar 获取 MD5SUM 值,写入到 MD5.txt 文件中
6、执行 tar flashattn_libs_*gitcommit* flashattn_libs_*gitcommit*.tar 命令整体打包
7、上传到 bos

文件名命名规则:flashattn_libs_*gitcommit*.tar,例如 flashattn_libs_6ea759b3ea9563b49d92f1ae0c4cb0fb26a7b365.tar

文件目录结构:

flashattn_libs_6ea759b3ea9563b49d92f1ae0c4cb0fb26a7b365/
├── fa_libs.tar
└── MD5.txt

Copy link

paddle-bot bot commented Dec 4, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@GuoxiaWang GuoxiaWang merged commit 5cbe145 into PaddlePaddle:develop Dec 6, 2024
27 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants