[ENG-6708] IndexStrategy revamp (more than one index per strategy, wow)#840
Merged
aaxelb merged 35 commits intoCenterForOpenScience:developfrom Jan 28, 2025
Merged
Conversation
felliott
reviewed
Jan 24, 2025
aaxelb
commented
Jan 24, 2025
Contributor
Author
aaxelb
left a comment
There was a problem hiding this comment.
(comments from group review)
Member
|
LGTM! We reviewed over zoom, all requested changes made! |
9cb91f3 to
5b5fc9f
Compare
5b5fc9f to
2d267eb
Compare
Member
|
Looks good! |
Contributor
Author
|
(merging despite the drop in test coverage, intending to follow up with more tests) |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
revamp
IndexStrategyto allow multiple indexes as part of a single coherent strategy -- this better allows common elasticsearch optimizations, like distinct indexes mapped for different kinds of queries(recommend hiding whitespace changes from diff, especially for changes to existing strategies)
simplify existing classes by making them dataclasses (with additional fields) -- an IndexStrategy instance knows its checksum (which may be non-current) and may have multiple SpecificIndex
IndexStrategy-- each instance represents a current or past version of the strategy, identified by checksumnamefield for disambig)indexStrategyquery param)IndexStrategy.SpecificIndex-- each instance represents a specific index that belongs to a strategy instance and may or may not existremove uniindex methods from IndexStrategy (and friends)
add replacement multiindex methods to IndexStrategy (and friends)
update existing IndexStrategy base methods
update
share.search.index_strategypublic interface (see all)update the "elasticsearch indexes" admin view to list multiple
update
trovesearch_denormstrategy, split its one index into two ("cards" and "iri_values")ENG-6708