This repository has been archived by the owner on Jul 24, 2024. It is now read-only.
Why use bn in projection head? #205
Comments
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
simclr/tf2/model.py
Line 178 in 3ad6700
In this code, bn is used in every layer of projection head, which is not mentioned in the papers.
Moreover, there is no bias in middle layer, which is conflict with the comments.
The text was updated successfully, but these errors were encountered: