Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use ivf_pq and ivf_flat from raft #5119

Merged
merged 13 commits into from
Jan 20, 2023

Conversation

benfred
Copy link
Member

@benfred benfred commented Jan 6, 2023

We are removing the faiss ANN code in rapidsai/raft#1121, in favour of
using the ivf_flat and ivf_pq implementations included with raft.

After this change, RAFT can be updated to remove the faiss ANN methods - which is implemented in
rapidsai/raft#1121

Note that this removes the ivf_sq option , since there is no corresponding implementation in raft.

Closes #5131

@benfred benfred requested review from a team as code owners January 6, 2023 21:56
@benfred benfred marked this pull request as draft January 6, 2023 21:56
@github-actions github-actions bot added CMake CUDA/C++ Cython / Python Cython or Python issue labels Jan 6, 2023
@benfred benfred changed the title Testing remove faiss ANN code from RAFT Use ivf_pq and ivf_flat from raft Jan 13, 2023
@benfred benfred marked this pull request as ready for review January 13, 2023 23:47
@github-actions github-actions bot removed the CMake label Jan 13, 2023
@cjnolet cjnolet added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Jan 17, 2023
@dantegd dantegd added breaking Breaking change and removed non-breaking Non-breaking change labels Jan 18, 2023
@dantegd
Copy link
Member

dantegd commented Jan 18, 2023

Added breaking label due to the removal of ivf_sq. It probably won't affect many people, but that should still be considered a breaking change.

@github-actions github-actions bot added the CMake label Jan 19, 2023
@github-actions github-actions bot removed the CMake label Jan 20, 2023
Copy link
Member

@cjnolet cjnolet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@codecov-commenter
Copy link

Codecov Report

Base: 69.63% // Head: 69.12% // Decreases project coverage by -0.51% ⚠️

Coverage data is based on head (d54e863) compared to base (1bf8f57).
Patch coverage: 95.60% of modified lines in pull request are covered.

Additional details and impacted files
@@               Coverage Diff                @@
##           branch-23.02    #5119      +/-   ##
================================================
- Coverage         69.63%   69.12%   -0.51%     
================================================
  Files               192      192              
  Lines             12523    12333     -190     
================================================
- Hits               8720     8525     -195     
- Misses             3803     3808       +5     
Impacted Files Coverage Δ
python/cuml/internals/__init__.py 100.00% <ø> (ø)
python/cuml/neighbors/__init__.py 100.00% <ø> (ø)
python/cuml/internals/api_decorators.py 97.59% <95.60%> (+1.52%) ⬆️
python/cuml/neighbors/kernel_density.py 75.97% <0.00%> (-11.69%) ⬇️
python/cuml/internals/import_utils.py 48.83% <0.00%> (+2.32%) ⬆️

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@cjnolet
Copy link
Member

cjnolet commented Jan 20, 2023

/merge

@rapids-bot rapids-bot bot merged commit 272f856 into rapidsai:branch-23.02 Jan 20, 2023
@benfred benfred deleted the remove_faiss_ann branch January 20, 2023 04:07
jakirkham pushed a commit to jakirkham/cuml that referenced this pull request Feb 27, 2023
We are removing the faiss ANN code in rapidsai/raft#1121, in favour of
using the ivf_flat and ivf_pq implementations included with raft.

After this change, RAFT can be updated to remove the faiss ANN methods  - which is implemented in
rapidsai/raft#1121

Note that this removes the `ivf_sq` option , since there is no corresponding implementation in raft.

Closes rapidsai#5131

Authors:
  - Ben Frederickson (https://github.com/benfred)

Approvers:
  - Corey J. Nolet (https://github.com/cjnolet)

URL: rapidsai#5119
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking Breaking change CUDA/C++ Cython / Python Cython or Python issue improvement Improvement / enhancement to an existing function
Projects
Development

Successfully merging this pull request may close these issues.

[FEA] Use IVF-PQ and IVF-FLAT from RAFT
4 participants