Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[LLM-paddle] add llama1-7b pretrain with callback #239

Merged
merged 15 commits into from
Sep 28, 2023
Merged

[LLM-paddle] add llama1-7b pretrain with callback #239

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
24630bf
modify gitignore
LaiXinyi823 Aug 24, 2023
cd32e31
add paddle llama
LaiXinyi823 Aug 20, 2023
efb63cc
add recompute and sharding for llama7b
LaiXinyi823 Aug 23, 2023
3e6bed6
adapte to the driver & fix start_paddle_task
LaiXinyi823 Aug 24, 2023
0678669
fix llama1-7b fig files and trainer
LaiXinyi823 Aug 24, 2023
45c4220
[callback] llama1-7B pretrain
LaiXinyi823 Sep 5, 2023
256107f
modify the llama case config name in test_conf.py
LaiXinyi823 Sep 7, 2023
af2fd2f
update config
DrownFish19 Sep 27, 2023
dc0b439
Merge remote-tracking branch 'flagperf/main' into callback
DrownFish19 Sep 27, 2023
925452b
Merge branch 'FlagOpen:main' into callback
DrownFish19 Sep 27, 2023
9b247dc
update config
DrownFish19 Sep 28, 2023
93d2542
Merge branch 'callback' of https://github.com/LaiXinyi823/FlagPerf in…
DrownFish19 Sep 28, 2023
94bd7b9
add metrics in README.md
DrownFish19 Sep 28, 2023
81ac81d
update README.md
DrownFish19 Sep 28, 2023
4eb09f6
remove llama 13B files
DrownFish19 Sep 28, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge remote-tracking branch 'flagperf/main' into callback
  • Loading branch information
@DrownFish19
DrownFish19 committed Sep 27, 2023
commit dc0b43902dbdaa7d0eb6e7dc0284ca77d96f44e1
4 changes: 3 additions & 1 deletion training/run_benchmarks/config/test_conf.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,5 +75,7 @@

# "transformer:pytorch_1.13:A100:1:8:1": "/raid/home_datasets_ckpt/transformer/train/",
# "swin_transformer:pytorch_1.8:A100:1:8:1": "/raid/dataset/ImageNet_1k_2012/",
# "llama1_7B:paddle_2.5.1:A100:1:8:1": "/home/dataset/llama1_7B/"
# "transformer_xl:pytorch_1.8:A100:1:8:1": "/raid/dataset/transformer_xl/",
# "t5_small:pytorch_1.8:A100:1:8:1": "/home/datasets_ckpt/t5_small_train",
# "gpt2:pytorch_1.12:A100:1:8:1": "/raid/dataset/gpt2",
}
You are viewing a condensed version of this merge commit. You can view the full changes here.