-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding "Principled Weight Initialization for Hypernetworks" #1
Comments
Hi Ohad, |
Hey,
I'm not sure how to implement this scheme for the LN, but for the feedforward network: |
Hi @OhadRubin |
I think for LN it won't work because it is multiplicative factor. |
Hi @OhadRubin , do you mind mentioning the line? |
@OhadRubin Hi, did you try to use the principle initialization method?And did this work? |
Hey,
Do you think it is possible to add the initialization from https://openreview.net/forum?id=H1lma24tPB to this model?
Thanks,
Ohad
The text was updated successfully, but these errors were encountered: