Skip to content

Commit

Permalink
cpm: add 1x1, 2x8
Browse files Browse the repository at this point in the history
  • Loading branch information
zhouyu committed Aug 4, 2023
1 parent 80c3c31 commit e3d19fc
Showing 1 changed file with 6 additions and 4 deletions.
10 changes: 6 additions & 4 deletions training/nvidia/cpm-pytorch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,9 @@

* 性能指标

| 配置 | precision | fix_hp | e2e_time | p_whole | p_train | p_core | acc | mem |
| ------------------ | --------- | ------------- | -------- | ------- | ------- | ------ | ----- | --------- |
| A100单机8卡(1x8) | fp16 | / | 1641 | 587 | 835 | 1059 | 0.92 | 12.9/40.0 |
| A100单机8卡(1x8) | fp16 | bs=256,lr=0.8 | 5469 | 771 | 1090 | 1292 | 0.918 | 23.1/40.0 |
| 配置 | precision | fix_hp | e2e_time | p_whole | p_train | p_core | acc | mem |
| ------------------- | --------- | ---------------- | -------- | ------- | ------- | ------ | ----- | --------- |
| A100单机8卡(1x8) | fp16 | / | 1641 | 587 | 835 | 1059 | 0.92 | 12.9/40.0 |
| A100单机8卡(1x8) | fp16 | bs=128,lr=0.002 | 5469 | 771 | 1090 | 1292 | 0.918 | 23.1/40.0 |
| A100单机单卡(1x1) | fp16 | bs=192,lr=0.0005 | | 78.4 | 111.9 | 127.2 | | 34.8/40.0 |
| A100两机8卡(2x8) | fp16 | bs=192,lr=0.0005 | | 1583 | 2221 | 2583.8 | | 29.9/40.0 |

0 comments on commit e3d19fc

Please sign in to comment.