Dear author, regarding the issue of training speed

[xiariyuni]

From my experience, when training a Qwen-2.5-3B model on 8×8 A100 (40G) nodes with a batch size of 256, the per-step time ranges from 40 to 50 minutes. Is this speed normal?

[AnselCmy]

Hi, training speed is an issue in current version and we've discussed here, we'll open-source a new version in few weeks, stay tuned!