Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix QBQTC in C-MTEB #1292

Merged
merged 2 commits into from
Oct 16, 2024
Merged

fix QBQTC in C-MTEB #1292

merged 2 commits into from
Oct 16, 2024

Conversation

ZiyiXia
Copy link
Contributor

@ZiyiXia ZiyiXia commented Oct 16, 2024 •
edited by isaac-chung
Loading

When reproducing C-MTEB evaluation, found that the QBQTC class (in STS/zho) should add a metadata_dict() function.

See dataset README:

相关性的含义：0，相关程度差；1，有一定相关性；2，非常相关。数字越大相关性越高。

isaac-chung
isaac-chung approved these changes Oct 16, 2024
View reviewed changes
Copy link
Collaborator

@isaac-chung isaac-chung left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Nice catch.

@isaac-chung isaac-chung enabled auto-merge (squash) October 16, 2024 22:33
@isaac-chung isaac-chung enabled auto-merge (squash) October 16, 2024 22:37
@isaac-chung isaac-chung merged commit 4a88a1d into embeddings-benchmark:main Oct 16, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@isaac-chung isaac-chung isaac-chung approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ZiyiXia @isaac-chung