-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Performance in T5.1.1 #6
Comments
Thanks for reporting this. I didn't try T5.1.1 before. I will look into this when I am not that swamped.... Probably some time at the end of November. |
Hello Sung 😄 |
I would love to, and I do have a simpler implementation right now. But currently, I don't have a concrete timeline for when I can contribute to the peft lib, as I have some new projects at hand now. |
We want to try other models (like llama) on your tuning algorithm, so hope you could take some time out to integrating your tuning algorithm into hugginface's peft lib. 😄 |
Hi, I think this is a very cool study.
I have a question about this study. Have you tried the T5.1.1?
When I experimented, it was confirmed that the performance of T5.1.1 was lower than that of T5.
Not only that, there were cases where the performance was significantly lower than full fine-tuning.
Do you have any comments regarding this?
The text was updated successfully, but these errors were encountered: