-
Notifications
You must be signed in to change notification settings - Fork 563
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[GRPO] Reorganize letter counting configs #1570
Conversation
@@ -13,7 +13,7 @@ | |||
# - Other training configs: configs/**/pretraining/, configs/**/sft/, configs/**/dpo/ | |||
|
|||
model: | |||
model_name: "Qwen/Qwen2-0.5B-Instruct" | |||
model_name: "deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does this model train w/o errors ? How much slower it is compared to 0.5B model ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was an unrelated error for model training, which I'm pretty sure didn't exist when i submitted my last PR. After fixing that, it trains. It's a bit slower, at 10 min for 5 steps instead of 6 min. The training speed seems rather variable though; for the 1.5B model, it goes from 5 steps after 10 min to 200 steps after 43 min. It's not just the first step that's slow (like with compilation), but the first couple.
Description
shard_for_eval
params for smaller models.Related issues
Towards OPE-1122
Before submitting