Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Linear evaluation #62

Open
noah822 opened this issue May 13, 2023 · 0 comments
Open

Linear evaluation #62

noah822 opened this issue May 13, 2023 · 0 comments

Comments

@noah822
Copy link

noah822 commented May 13, 2023

I followed the code provided in the notebook to do my own research. I found that the loaded checkpoint for cifar10 will project image into a 1000 dimension vector, which is not 512 as reported in README. Is this expected or my interpretation is incorrect.

To do linear eval, do we need to append a MLP, which first projects 1000-d vector to 512-d, interpreted as feature, then projects it to 128-d, followed by a 128-to-10 classifier.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant