-
Notifications
You must be signed in to change notification settings - Fork 466
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add splade-pp-ed beir regression files #2270
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #2270 +/- ##
=========================================
Coverage 62.95% 62.96%
- Complexity 1271 1272 +1
=========================================
Files 196 196
Lines 11418 11418
Branches 1452 1452
=========================================
+ Hits 7188 7189 +1
Misses 3708 3708
+ Partials 522 521 -1 ☔ View full report in Codecov by Sentry. |
This is what we have right now: % ls src/main/resources/regression/msmarco-* | grep splade
src/main/resources/regression/msmarco-passage-distill-splade-max.yaml
src/main/resources/regression/msmarco-passage-splade-distil-cocodenser-medium.yaml
src/main/resources/regression/msmarco-passage-splade-pp-ed-onnx.yaml
src/main/resources/regression/msmarco-passage-splade-pp-ed.yaml
src/main/resources/regression/msmarco-passage-splade-pp-sd-onnx.yaml
src/main/resources/regression/msmarco-passage-splade-pp-sd.yaml
src/main/resources/regression/msmarco-v2-passage-splade-pp-ed.yaml
src/main/resources/regression/msmarco-v2-passage-splade-pp-sd.yaml Let's be consistent and call it |
model renamed |
Awesome, thanks @justram for this! Let's get this merged in, and I'll run tests on my end. |
Happy to help! |
yup, will do! |
/mnt/users/j587yang/collections/beir-v1.0.0