You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
See discussion in #429 for full context. Relevant snippets form that discussion below:
In my experience "_module" prefix is always an annoyance and never helps.
In particular, getting rid of the prefix makes it much easier to load weights from publicly pre-trained models (currently you have to do it strictly before you wrap a model with GSM).
...today you have to be careful and load_state_dict before you wrap the model with GradSampleModule. With same state_dicts you don't have to worry about it.
The text was updated successfully, but these errors were encountered:
🚀 Feature
Motivation
See discussion in #429 for full context. Relevant snippets form that discussion below:
The text was updated successfully, but these errors were encountered: