Skip to content

Pull requests: embeddings-benchmark/mteb

New pull request New
37 Open 2,982 Closed
37 Open 2,982 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: reconstruct main_score for legacy reranking and pair-classification results
#4920 opened Jul 13, 2026 by fzoll Contributor Loading…
1
Fix #4375: load MSR-VTT via standard retrieval format
#4919 opened Jul 13, 2026 by fzoll Contributor Loading…
1
1
Fix #4368: Add CO₂ inference-cost estimate (gCO₂/Mtoken) to model metadata
#4918 opened Jul 13, 2026 by fzoll Contributor Loading…
1
1
docs: add icon to hybrid model page
#4915 opened Jul 13, 2026 by fzowl Contributor Loading…
1
feat: add LMEB memory-type grouping leaderborad
#4914 opened Jul 13, 2026 by cosylsine Loading…
3 tasks
1
6
InjongoIntent: dropped eng config
#4913 opened Jul 11, 2026 by O-Nicolinho Loading…
Fixed AfriSentiLangClassification: repointed dead HausaNLP dataset to mteb's supported (and functional) one
#4912 opened Jul 11, 2026 by O-Nicolinho Loading…
1
fix to EmotionAnalysisPlus : align task with pre-processed mirror export
#4911 opened Jul 11, 2026 by O-Nicolinho Loading…
1
model: Add fusion-embedding-1 (EximiusLabs/fusion-embedding-1-2b-preview) new model Questions related to adding a new model to the benchmark
#4909 opened Jul 10, 2026 by abtonmoy Loading…
7 tasks done
4
Fix AfriMTEB task schema issues
#4905 opened Jul 8, 2026 by TianyouXie828 Loading…
1
fix ModelMeta Validation
#4904 opened Jul 8, 2026 by ayush1298 Collaborator Loading…
1
14
Leaderboard integation with experiments leaderboard issues related to the leaderboard
#4900 opened Jul 6, 2026 by Samoed Member • Draft
1
fix: reupload MSR-VTT in standard retrieval format (#4375)
#4899 opened Jul 6, 2026 by fzowl Contributor Loading…
1
1
fix: correctly isolate splits when aggregating scores in aggregated tasks
#4897 opened Jul 5, 2026 by pranaysb Contributor Loading…
1
9
Add instructor models (base, large, xl) new model Questions related to adding a new model to the benchmark
#4883 opened Jul 3, 2026 by 11shafayet Loading…
7 tasks done
1
8
Add CO₂ estimate per million tokens from active parameters
#4878 opened Jul 2, 2026 by fzowl Contributor Loading…
1
1
dataset: add cleaned STSBenchmark v2
#4876 opened Jul 2, 2026 by wgu9 Contributor Loading…
1
12
fix: reconstruct main_score for legacy reranking and pair-classification results
#4874 opened Jul 1, 2026 by fzowl Contributor Loading…
1
1
Cap Seq Length for Some Models
#4873 opened Jul 1, 2026 by AdnanElAssadi56 Contributor Loading…
1
Expand MTEB(kor, v1) with retrieval/STS/NLI/clustering tasks + register 9 Korean models new benchmark Issues related to adding a new benchmark
#4870 opened Jul 1, 2026 by daegonYu Contributor Loading…
30
agentic: add answer-mode retrieval core (contract, evaluator, baselines)
#4869 opened Jun 30, 2026 by AdnanElAssadi56 Contributor Loading…
5
Add structure-aware corpus-adaptive hybrid retriever
#4867 opened Jun 30, 2026 by thu-nmrc Loading…
5
model: Add VoiceNet voiceclap-large and voiceclap-small
#4864 opened Jun 29, 2026 by fzowl Contributor Loading…
1
feat: add retrieval keyword-overlap descriptive stats
#4860 opened Jun 28, 2026 by wgu9 Contributor Loading…
1
9
Add model: google/gemini-embedding-2 (GA)
#4859 opened Jun 27, 2026 by fzoll Contributor Loading…
1
1
ProTip! What’s not been updated in a month: updated:<2026-06-13.