Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor tolerance checking approach and tweak yaml configs #2592

Merged
merged 29 commits into from
Sep 19, 2024
Merged

Refactor tolerance checking approach and tweak yaml configs #2592

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
f8a96f5
Tweak yaml files
lintool Sep 7, 2024
360a1d7
Merge branch 'master' of github.com:castorini/anserini into refactoring
lintool Sep 7, 2024
a94e970
Initial addition of tolerance scores in yaml
lintool Sep 10, 2024
32c22de
Merge branch 'master' into refactoring
lintool Sep 11, 2024
9552f0c
sync, regressions for flat-int8
lintool Sep 11, 2024
1ec43ea
flat-int8 onnx
lintool Sep 11, 2024
8269ae5
more tweaks, ms marco.
lintool Sep 11, 2024
4c6b7db
Fixed metrics typo.
lintool Sep 11, 2024
a15106e
tweaks to flat scores for msmarco.
lintool Sep 12, 2024
51d6dd5
initial hnsw cached beir scores.
lintool Sep 12, 2024
530bd03
adjust based on scores
lintool Sep 12, 2024
1ec9b7c
add rest of hnsw scores.
lintool Sep 12, 2024
e2716b2
Tweak tolerance.
lintool Sep 13, 2024
deee1ee
More tolearance tweaks.
lintool Sep 13, 2024
a6578a3
Added hnsw stubs.
lintool Sep 13, 2024
e9c2402
tweaks
lintool Sep 13, 2024
7db41f5
another round of tweaks.
lintool Sep 13, 2024
5996a8e
more tolerance tweaks, removed dead code.
lintool Sep 13, 2024
33ed276
tolerance tweaks
lintool Sep 15, 2024
4f1f1c3
Initial cohere metrics.
lintool Sep 15, 2024
a66c7ab
calibrating cohere
lintool Sep 15, 2024
c1bfce5
cohere tweaks.
lintool Sep 15, 2024
c1e27f5
Merge branch 'master' into refactoring
lintool Sep 15, 2024
69fed51
refresh
lintool Sep 15, 2024
87d17b5
Fixed test.
lintool Sep 15, 2024
4415737
More score tweaks.
lintool Sep 17, 2024
2ccc9cc
another round of tweaks.
lintool Sep 18, 2024
a8ae8f9
more tweaks.
lintool Sep 18, 2024
5ce0101
one final round of tweaks.
lintool Sep 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
Tweak yaml files
  • Loading branch information
@lintool
lintool committed Sep 7, 2024
commit f8a96f548bb75dd82be505742f2016039239023e
2 changes: 1 addition & 1 deletion .../regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-arguana.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-arguana.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-arguana.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-arguana.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 500 -noMerge -quantize.int8 \
-M 16 -efC 500 -quantize.int8 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-bioasq.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-bioasq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-bioasq.bge-base-en-v1.5/ \
-M 16 -efC 500 -noMerge \
-M 16 -efC 500 \
>& logs/log.beir-v1.0.0-bioasq.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ssions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-climate-fever.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-climate-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-climate-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-climate-fever.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-android.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-english.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...s/regressions-beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ssions/regressions-beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-gaming.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ions/regressions-beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...gressions/regressions-beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-gis.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ressions-beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...s/regressions-beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-mathematica.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion .../regressions-beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-physics.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ressions-beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...s/regressions-beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-programmers.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ns/regressions-beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...essions/regressions-beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-stats.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ions/regressions-beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...gressions/regressions-beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-tex.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ons/regressions-beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ressions/regressions-beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-unix.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...gressions-beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ns/regressions-beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-webmasters.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...egressions-beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...ons/regressions-beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-cqadupstack-wordpress.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...sions/regressions-beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...egressions/regressions-beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-dbpedia-entity.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-fever.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-fever.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-fever.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fever.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-fever.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-fever.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-fiqa.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fiqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-fiqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-fiqa.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-fiqa.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-fiqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-fiqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-fiqa.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-hotpotqa.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-hotpotqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-hotpotqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-hotpotqa.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-hotpotqa.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-hotpotqa.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-hotpotqa.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-hotpotqa.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion ...regressions/regressions-beir-v1.0.0-nfcorpus.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nfcorpus.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-nfcorpus.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-nfcorpus.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-nfcorpus.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nfcorpus.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-nfcorpus.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-nfcorpus.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-nq.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-nq.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-nq.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-nq.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-nq.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-nq.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-nq.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-quora.bge-base-en-v1.5.hnsw-int8.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-quora.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw-int8.beir-v1.0.0-quora.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge -quantize.int8 \
-M 16 -efC 100 -quantize.int8 \
>& logs/log.beir-v1.0.0-quora.bge-base-en-v1.5 &
```

Expand Down
2 changes: 1 addition & 1 deletion docs/regressions/regressions-beir-v1.0.0-quora.bge-base-en-v1.5.hnsw.onnx.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ bin/run.sh io.anserini.index.IndexHnswDenseVectors \
-input /path/to/beir-v1.0.0-quora.bge-base-en-v1.5 \
-generator DenseVectorDocumentGenerator \
-index indexes/lucene-hnsw.beir-v1.0.0-quora.bge-base-en-v1.5/ \
-M 16 -efC 100 -memoryBuffer 65536 -noMerge \
-M 16 -efC 100 \
>& logs/log.beir-v1.0.0-quora.bge-base-en-v1.5 &
```

Expand Down
Loading