-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mixed precision with Deepspeed #15168
Comments
Hi @wangleiofficial, I met the problem same with you. Do you fix it? |
@Line290 Not yet,i guess the part parameters(Pretrained model) are not handled correctly. |
I've got the same problem, any fixes yet? |
This issue has been automatically marked as stale because it hasn't had any recent activity. This issue will be closed in 7 days if no further activity occurs. Thank you for your contributions - the Lightning Team! |
+1, deepspeed_stage2 meets the same error. |
Similar problem with deepspeed_stage_1.
|
Bug description
When using mixed precision with Deepspeed, the model resulted in the error:
RuntimeError: expected scalar type Float but found Half
.How to reproduce the bug
Error messages and logs
Environment
Current Environment
More info
No response
cc @awaelchli
The text was updated successfully, but these errors were encountered: