Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable BERTScore evaluates hypotheses against multiple references. #647

Open
stancld opened this issue Nov 30, 2021 · 0 comments
Open

Enable BERTScore evaluates hypotheses against multiple references. #647

stancld opened this issue Nov 30, 2021 · 0 comments
Labels
enhancement New feature or request topic: Text
Milestone
future

Comments

@stancld
Copy link
Contributor

stancld commented Nov 30, 2021 •
edited
Loading

🚀 Enhancement

Enable BERTScore evaluates hypotheses against multiple references.

Motivation

Plenty of NMT evaluation metrics allow evaluating a hypothesis against multiple references if provided. I think it would be nice to enable this option also for BERTScore for consistent behaviour.

Pitch

Enable BERTScore evaluates hypotheses against multiple references.
Note: It's already implemented in the reference package: https://github.com/Tiiiger/bert_score/blob/94fe4240aed59f59a5ca68d857a7e4c2559c478b/bert_score/scorer.py#L175
@stancld stancld added the enhancement New feature or request label Nov 30, 2021
@Borda Borda added this to the v0.7 milestone Dec 8, 2021
@stancld stancld mentioned this issue Dec 18, 2021
Closed
4 tasks
@Borda Borda modified the milestones: v0.7, v0.8 Jan 6, 2022
@Borda Borda modified the milestones: v0.8, v0.9 Mar 22, 2022
@SkafteNicki SkafteNicki removed this from the v0.9 milestone May 12, 2022
@SkafteNicki SkafteNicki added this to the future milestone Oct 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request topic: Text
Projects
None yet
Milestone
future
Development

No branches or pull requests
5 participants
@Borda @SkafteNicki @stancld and others