Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: replace search engine plugin by lucene and SQL service #3893

Closed
3 of 4 tasks
ymarcon opened this issue Aug 18, 2024 · 0 comments
Closed
3 of 4 tasks

feat: replace search engine plugin by lucene and SQL service #3893

ymarcon opened this issue Aug 18, 2024 · 0 comments

Comments

@ymarcon
Copy link
Member

ymarcon commented Aug 18, 2024 •
edited
Loading

If feasible...

  • variables indexing could be done directly in lucene which can be embedded and provides a full text search api
  • variable summaries are cached in opal directly
  • entities count based on values from different tables could be done with SQL
  • contingency tables are done with SQL

SQL service assigns data in a R server: that takes time for the first assignment but at least that works.
@ymarcon ymarcon changed the title feat: replace search engine plugin by lucene feat: replace search engine plugin by lucene and SQL service Aug 18, 2024
ymarcon added a commit that referenced this issue Aug 18, 2024
@ymarcon
feat: removed deprecated facet search resources, added contingency se…
519772c 
…rvice and table resource #3893
@ymarcon ymarcon mentioned this issue Aug 18, 2024
Merged
kazoompa pushed a commit that referenced this issue Aug 19, 2024
@ymarcon
feat: refactoring search service (wip) #3893 (#3894)
10e7a49 
* feat: removed deprecated facet search resources, added contingency service and table resource #3893

* feat: search service does not depend on an external plugin; variable summaries are precomputed and cached when indexing table values; variables index is a stub for non (wip)

* feat: drop variables/values/summaries index on table/variable renamed/updated/deleted

* feat(ui): table indexer added
@ymarcon ymarcon closed this as completed Aug 28, 2024
@ymarcon ymarcon mentioned this issue Aug 30, 2024
Closed
ymarcon added a commit that referenced this issue Aug 30, 2024
@ymarcon
feat: table index scheduling, values index cleaning #3893 (#3904)
be916e2 
* feat: table index schedule

* feat: clean values index in admin
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ymarcon