-
-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Lucene search #11542
Merged
Merged
Lucene search #11542
Changes from 1 commit
Commits
Show all changes
331 commits
Select commit
Hold shift + click to select a range
0f32e91
Use pattern matching for cast
btut 231f200
Fix pattern matching
btut 202f514
Merge branch 'main' into version6
btut f602207
Merge branch 'version6' into luceneSearchBackend
btut 675d75c
Fix merge
btut 49eeb1d
Speed up switches between sorting/filtering modes
btut a25fa00
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus 08aca25
Fixed merge errors
calixtus 15b2152
Fixed small issues
calixtus f8b643b
Removed obsolete tests, fixed some tests
calixtus 229fed7
Merge branch 'main' into luceneSearchBackend
koppor 536ecfa
Fixed merge error in CHANGELOG.md
calixtus 1117e17
Fixed checkstyle
calixtus ff4ad1c
Fixed more tests
calixtus 7bdccf0
Removed obsolete tests
calixtus 40de951
Fixes "Fixed merge error in CHANGELOG.md" by removing duplicate entries
koppor cbb5461
Merge remote-tracking branch 'upstream/luceneSearchBackend' into luce…
calixtus 9e8863d
Merge branch 'main' into luceneSearchBackend
calixtus 1f38a68
WiP on tests
calixtus 5467095
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus 00cecf8
Checkstyle
calixtus ad85c77
Checkstyle
calixtus 3c1c08e
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus 8981cdd
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus 986bf3f
Merge remote-tracking branch 'upstream/luceneSearchBackend' into luce…
calixtus ed5cebf
Update Java version
calixtus afc4d67
Refine logging
koppor 2f3203f
Fix compile error
koppor c771458
Add LuceneTest
koppor b795fa6
Update CHANGELOG.md
koppor 29759bb
Move search classes to pdf package
LoayGhreeb b084538
Merge branch 'main' into update-lucene-branch
LoayGhreeb 0dc1c2d
Move search classes to search package
LoayGhreeb d5c87df
rewriteRun
LoayGhreeb a0c3a71
Merge branch 'main' into update-lucene-branch
LoayGhreeb bfc33c8
Remove bibEntry from DocumentReader
LoayGhreeb 17fd483
Merge branch 'main' into update-lucene-branch
LoayGhreeb c0098c9
Rewrite LuceneIndexer
LoayGhreeb cebaa1c
Remove IndexingTaskManager
LoayGhreeb 81a0988
Merge branch 'main' into update-lucene-branch
LoayGhreeb 14a612d
Merge branch 'main' into update-lucene-branch
LoayGhreeb f3c5cfa
Separate Bib fields index and LinkedFiles index
LoayGhreeb 50299b2
Merge branch 'main' into update-lucene-branch
LoayGhreeb a12653d
Fix null LuceneManager in ExternalFilesEntryLinker
LoayGhreeb 007898a
Save as action
LoayGhreeb c4e02d6
Clear linkedFiles indexer when fullText indexing is disabled in prefe…
LoayGhreeb c6faa35
Merge branch 'main' into update-lucene-branch
LoayGhreeb 0c0d6ba
remove comments
LoayGhreeb 6b5e66a
get indexed files on update
LoayGhreeb 4c23c4e
Merge branch 'main' into update-lucene-branch
LoayGhreeb 50a6db4
Merge branch 'main' into update-lucene-branch
LoayGhreeb 3c1c0ef
Add LUCENE_MANAGERS map for accessing managers by databaseContext.getUid
LoayGhreeb c2181ec
Move LuceneManager from search.indexing package to search
LoayGhreeb 00ec1de
Fix wrong order for import
LoayGhreeb ad95628
Move SearchQuery to model package
LoayGhreeb 4732d25
Fix issue with opening multiple unsaved libraries
LoayGhreeb 9887362
Merge branch 'main' into update-lucene-branch
LoayGhreeb c692b30
Pass LuceneManager down to the entry editor
LoayGhreeb 27fdde1
Improve searching performance
LoayGhreeb 9708b29
Merge branch 'main' into update-lucene-branch
LoayGhreeb ab5388f
Change SearchFieldConstants to enum
LoayGhreeb 9242516
More performance improvements for searching
LoayGhreeb 2cc4f39
Merge branch 'main' into update-lucene-branch
LoayGhreeb d8bc078
Merge branch 'main' into update-lucene-branch
LoayGhreeb 9219eec
Update FulltextSearchResultsTab.java
LoayGhreeb 99938d9
Fix group union, intersection
LoayGhreeb d70342f
Fix backgroundtask
calixtus f9731d1
Merge remote-tracking branch 'LoayGhreeb/update-lucene-branch' into f…
calixtus bbf8d19
Fix subscriptions
calixtus 8d6e06c
Remove lastSearchQueryLogic
calixtus fb3c097
Fix possible NPE
calixtus b8c6e9a
Fix searchTask check
calixtus 7e75341
Merge branch 'main' into update-lucene-branch
LoayGhreeb 136225d
Merge branch 'main' into update-lucene-branch
LoayGhreeb b13d81e
Remove sort by score flag
LoayGhreeb 4f679de
Fix score column sorting
LoayGhreeb 12c9869
Fix modifier buttons listener
LoayGhreeb d94a1b1
Add search rank column
LoayGhreeb 3671fdf
Merge branch 'main' into update-lucene-branch
LoayGhreeb cf271d5
hide search rank column from preferences
LoayGhreeb 5b42e70
Add search_rank column to sort order by default
LoayGhreeb 33cc770
Merge branch 'main' into update-lucene-branch
LoayGhreeb 8abee27
Update CHANGELOG.md
LoayGhreeb c30edfb
fix typo
LoayGhreeb 2fe8e3b
Merge branch 'main' into update-lucene-branch
LoayGhreeb cf49713
Change the order of the rank
LoayGhreeb bec28bf
Merge branch 'main' into update-lucene-branch
koppor bf94797
Merge branch 'main' into update-lucene-branch
LoayGhreeb 4352e77
Merge branch 'update-lucene-branch' into LuceneSearch
LoayGhreeb 3203439
Merge branch 'main' into LuceneSearch
LoayGhreeb d67b988
Use NGramAnalyzer for indexing
LoayGhreeb aa81985
Merge branch 'main' into LuceneSearch
LoayGhreeb aac90cd
Resolve conflicts
LoayGhreeb 1ec38d5
Merge branch 'main' into LuceneSearch
LoayGhreeb f28af55
update search matches with lucene
LoayGhreeb 17f834a
PreviewViewer highlighting with Lucene
LoayGhreeb f660551
Merge branch 'main' into LuceneSearch
LoayGhreeb 76297a0
Delete IndexingTaskManager.java
LoayGhreeb 6d4e992
SourceTab highlighting with Lucene
LoayGhreeb e71087e
Fix non-ASCII characters
LoayGhreeb f4d24f6
Extract query terms from search query
LoayGhreeb 805a5a0
Highlight regex queries
LoayGhreeb 2446ccd
return js highlight function
LoayGhreeb 20d7096
Fix invalid search query throw exception
LoayGhreeb 77a4c92
Merge branch 'main' into LuceneSearch
LoayGhreeb 793dd59
Refactor Lucene indexer classes
LoayGhreeb 1b1cdbb
Refactor linked files indexer
LoayGhreeb 4e7defa
Merge branch 'main' into LuceneSearch
LoayGhreeb 43c8d9d
Update search matches when entries are added or updated
LoayGhreeb f58b1e8
Remove preferences from ActionHelper
LoayGhreeb b8be4ee
Merge branch 'main' into LuceneSearch
LoayGhreeb 09f3ea5
checkstyle
LoayGhreeb e47ba65
comment out search tests
LoayGhreeb a8f7d18
OpenRewrite
LoayGhreeb 97ecff1
Fix Groups Parser/Serializer
LoayGhreeb 87408a1
Localization
LoayGhreeb abd5652
Merge branch 'main' into LuceneSearch
LoayGhreeb b5a2774
Search groups
LoayGhreeb 1fe163e
Merge remote-tracking branch 'upstream/main' into LuceneSearch
koppor 3939064
Release `IndexSearcher` after completing search task
LoayGhreeb 52b04e4
Merge branch 'main' into LuceneSearch
LoayGhreeb 8c8becc
Checkstyle
LoayGhreeb 4dea5f3
Merge branch 'main' into LuceneSearch
LoayGhreeb 363f46b
Correct typo
LoayGhreeb 78ab566
Remove GroupSearchQuery
LoayGhreeb 210a824
Remove EventBus from LuceneManager and use BibDatabase eventBus
LoayGhreeb 193d533
Fix number of matched entries in groups
LoayGhreeb 4ca8afb
Fix search groups
LoayGhreeb 9ca71c7
Merge branch 'main' into LuceneSearch
LoayGhreeb 26a49d4
Localization
LoayGhreeb d26929e
Remove bib fields highlighter
LoayGhreeb e4c9d91
Pass LuceneManager to search groups
LoayGhreeb 3400c92
Fix performance issues by caching matched entries
LoayGhreeb e4fe911
Update GroupDialogViewModelTest.java
LoayGhreeb 707063a
Update main table matches
LoayGhreeb 63cba32
Fix groups icon
LoayGhreeb fd531a6
Restore Search.g4 and GrammarBasedSearchRule
LoayGhreeb fcc8c9c
First version of search group migration
koppor 660e354
Add groups field to the index
LoayGhreeb 9d0d718
Merge branch 'main' into LuceneSearch
LoayGhreeb fca2f93
Merge branch 'LuceneSearch' of https://github.com/Jabref/jabref into …
LoayGhreeb c6c9065
Remove search rules
LoayGhreeb 05aab8d
Localization
LoayGhreeb c19d01d
Add test cases
LoayGhreeb 67c6c4d
Fix names
koppor ba660d4
Add some more functionality
koppor e46e0a2
Always add "all" prefix
koppor 699e921
Add comment for alternative implementation
koppor f671f08
Mark library tab changed after migration
koppor 3e6a179
Add another test for regular expression
koppor 2018cea
Small fixes
koppor 04105a8
Fix markBaseChanged
koppor cc3c002
Fix adding new entries did not update MatchCategory
LoayGhreeb 909afe4
Fix searching for Non-ASCII characters
LoayGhreeb bfa1356
Fix escaping special characters
LoayGhreeb ec5bfbb
Fix tests
LoayGhreeb 9efbf55
Add first draft of LatexToUnicodeFoldingFilter
koppor e95674a
Fix LatexToUnicodeFoldingFilter
LoayGhreeb 02c8ca0
Remove LatexToUnicode from SearchQuery
LoayGhreeb 7b95f8d
Localization
LoayGhreeb a0ff7fb
AllowedToUseLogic
LoayGhreeb eb989f4
Merge branch 'main' into LuceneSearch
koppor b55ab31
Update CHANGELOG.md
koppor 0b7284d
Use sentence case for search result heading
koppor 37c8325
Add CHANGELOG for change in JabRefFrameViewModel
koppor 8faad33
Add more changes to CHANGELOG.md
koppor cd71f11
Add ADR-0038
koppor beb3881
Rename "SCORE" to "MATCH_SCORE"
koppor 59a5e54
Add link to ADR-0038
koppor bc28532
Add another CHANGELOG.md entry
koppor 85f4a4b
Add CHANGELOG.md entry
koppor d22ef7b
Revert change of filename
koppor 9ca8416
Add JavaDoc comment
koppor 4ebb256
Trying to find better names
koppor e64242d
Discard changes to src/main/resources/tinylog.properties
koppor f6b3d94
Remove commented out code
koppor 7d2834b
Remove obsolete testing class
koppor 033226c
Remove obsolete test
koppor 5d0118d
Discard changes to src/test/resources/tinylog-test.properties
koppor 78264d7
Remove completely disabled code
koppor 6616c2a
Merge branch 'LuceneSearch' of github.com:JabRef/jabref into LuceneSe…
koppor 73890f1
Merge branch 'main' into LuceneSearch
koppor 3dfd01e
Rename "all" to "any"
LoayGhreeb e2c430b
Catch thrown exception
LoayGhreeb 05b6270
Remove groups field from the default field
LoayGhreeb cde42f0
Remove SearchGroupsListener
LoayGhreeb 5cc1312
Update Benchmarks.java
LoayGhreeb 5818452
Update module-info.java
LoayGhreeb ff56ea9
Fixes from code review on LibraryTab
LoayGhreeb 2310625
Remove regex button from search bar
LoayGhreeb f369b09
Use BibEntry.getId instead of System.identityHashCode
LoayGhreeb 27ed105
Add BibEntry index map
LoayGhreeb a1461e5
Readd option
koppor 53e274d
Add `@ADR` annotation
koppor d4754ca
Add some comment
koppor 71732a6
One more annotation
koppor f4a5567
Add CHANGELOG.md entry
koppor f3f454c
One more annotation
koppor a23e047
Add CHANGELOG.md entry
koppor edfb3cc
Revert "Add BibEntry index map"
LoayGhreeb 94b27eb
Use binary search to find the index of the entry
LoayGhreeb edb2ab6
openrewrite
LoayGhreeb 24cf9f7
Tests for LinkedFilesIndexer
LoayGhreeb c3c9d12
Fix DatabaseSearcher
LoayGhreeb e3c3256
LocalizationConsistencyTest
LoayGhreeb 12ff246
DatabaseSearcherWithBibFilesTest
LoayGhreeb 36ee112
Fix typo in CHANGELOG.md
koppor 15ed52b
Fix typo
LoayGhreeb cd6e55f
Use parameterized test for DatabaseSearcherTest
LoayGhreeb df5d7c1
Fix DatabaseSearcherWithBibFiles tests
LoayGhreeb 4872dc5
Fix exportMatches test
LoayGhreeb bb90047
Merge branch 'main' into LuceneSearch
LoayGhreeb b12fa56
Remove regex check box from search groups dialog
LoayGhreeb 1351add
JavaDoc
LoayGhreeb a8a1c2a
Fix SearchGroups test
LoayGhreeb d20cf5c
Remove closeAndWait methods and use CurrentThreadTaskExecutor
LoayGhreeb 0957707
Fix architecture test
LoayGhreeb f923502
Allow to use logic
LoayGhreeb 6b6bca3
Add debug logging for search
LoayGhreeb efb5324
Add more logging
LoayGhreeb 48aa091
Assert with containsInAnyOrder
LoayGhreeb d4b5e8a
Fix DatabaseSearcher test
LoayGhreeb 48fe7ca
Global search dialog
LoayGhreeb bb1d8c5
Merge branch 'main' into LuceneSearch
LoayGhreeb 68d1df8
Rename method
LoayGhreeb 1005685
Improve code quality
LoayGhreeb 84a2754
Use non-static preferences variables
LoayGhreeb a8a845f
Update CHANGELOG.md
LoayGhreeb d6fbf55
Delete SearchGroupTest.java
LoayGhreeb eeadaee
fix typo
LoayGhreeb 0959592
fix indentation
LoayGhreeb 29d2ad3
Update matchedEntries on the UI thread
LoayGhreeb 0a7b92f
Discard changes to src/main/java/org/jabref/gui/importer/actions/GUIP…
LoayGhreeb 0ecfae4
Merge branch 'main' into LuceneSearch
LoayGhreeb 5bcb82d
Fix LoayGhreeb#12
LoayGhreeb 09d5148
Sync search flags between search bar and global search bar
LoayGhreeb a9a8a7c
Move VERSION_6_0_ALPHA const to SearchGroupsMigrationAction
LoayGhreeb 146e3f7
Refactor LuceneSearcher
LoayGhreeb 558b1b3
Use linked files analyzer for highlighting full-text results
LoayGhreeb 54fd783
Merge branch 'main' into LuceneSearch
LoayGhreeb e6f3b5d
Fix line break
LoayGhreeb 95458d3
Fix tests
LoayGhreeb e5665ce
Use EnglishAnalyzer for indexing/searching linked files
LoayGhreeb ce21f4a
Ask to wait for linked files indexing on shutdown
LoayGhreeb cf92f0a
Merge branch 'main' into LuceneSearch
LoayGhreeb 6dbc187
Use EdgeNGram instead of NGram
LoayGhreeb c9d8230
Return comment
LoayGhreeb fa8344b
Update CHANGELOG.md
LoayGhreeb 5f05f4a
Merge branch 'main' into LuceneSearch
LoayGhreeb ab87e24
Merge branch 'main' into LuceneSearch
LoayGhreeb File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
JavaDoc
- Loading branch information
commit 1351add4ef7d16959cc74ee600b31f824b719170
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Logger won't work with cli I think
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please check the code 20 lines above.
I checked it.
My review comment was under the assumption that the risk that the exception was thrown is equally high than the other IOExceptions
I also know that tinylog outputs to the console in the case of CLI.