Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for evaluation metrics #393

Open
victorleeasu opened this issue Mar 26, 2024 · 3 comments
Open

Request for evaluation metrics #393

victorleeasu opened this issue Mar 26, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@victorleeasu
Copy link

Hello, could you report the evaluations for example accuracy and F1 scores for the tasks that are not reported in the paper(especially the newly added ones)? It would help greatly to use the model and make citations.

This is an awesome project and definitely more accessible and easy to implement due to your hard work of making examples and even a huggingface space.
Thank you.

@victorleeasu victorleeasu added the bug Something isn't working label Mar 26, 2024
@yangheng95
Copy link
Owner

I didn't get that. Can you elaborate on your questions with more details?

@victorleeasu
Copy link
Author

Oh, sorry about that.
I meant whether you could share the information about the pretrained models.
E.g., Precision, recall, and F1 scores for the tasks (e.g., ASQP, ASTE).

@yangheng95
Copy link
Owner

There is no such information, because this project is in a low-active stage.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants