Why no conversion to fp32 when using mixed precision with bf16? #11157
max-fofanov
started this conversation in
General
Replies: 1 comment 1 reply
-
Beta Was this translation helpful? Give feedback.
1 reply
-
|
As I see it now, mixed precision with bf16 is basically pure bf16 training |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
The question is in the title. Thanks in advance for your answer!
Beta Was this translation helpful? Give feedback.
All reactions