Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lucene search #11542

Merged
merged 331 commits into from
Sep 5, 2024
Merged
Changes from 1 commit
Commits
Show all changes
331 commits
Select commit Hold shift + click to select a range
0f32e91
Use pattern matching for cast
btut Nov 6, 2022
231f200
Fix pattern matching
btut Nov 7, 2022
202f514
Merge branch 'main' into version6
btut Nov 7, 2022
f602207
Merge branch 'version6' into luceneSearchBackend
btut Nov 7, 2022
675d75c
Fix merge
btut Nov 7, 2022
49eeb1d
Speed up switches between sorting/filtering modes
btut Nov 7, 2022
a25fa00
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus Dec 27, 2022
08aca25
Fixed merge errors
calixtus Dec 27, 2022
15b2152
Fixed small issues
calixtus Jan 1, 2023
f8b643b
Removed obsolete tests, fixed some tests
calixtus Jan 3, 2023
229fed7
Merge branch 'main' into luceneSearchBackend
koppor Jan 3, 2023
536ecfa
Fixed merge error in CHANGELOG.md
calixtus Jan 4, 2023
1117e17
Fixed checkstyle
calixtus Jan 4, 2023
ff4ad1c
Fixed more tests
calixtus Jan 4, 2023
7bdccf0
Removed obsolete tests
calixtus Jan 4, 2023
40de951
Fixes "Fixed merge error in CHANGELOG.md" by removing duplicate entries
koppor Jan 4, 2023
cbb5461
Merge remote-tracking branch 'upstream/luceneSearchBackend' into luce…
calixtus Jan 4, 2023
9e8863d
Merge branch 'main' into luceneSearchBackend
calixtus Jan 10, 2023
1f38a68
WiP on tests
calixtus Jan 23, 2023
5467095
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus Sep 12, 2023
00cecf8
Checkstyle
calixtus Sep 12, 2023
ad85c77
Checkstyle
calixtus Sep 12, 2023
3c1c08e
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus Sep 25, 2023
8981cdd
Merge remote-tracking branch 'upstream/main' into luceneSearchBackend
calixtus Sep 25, 2023
986bf3f
Merge remote-tracking branch 'upstream/luceneSearchBackend' into luce…
calixtus Sep 25, 2023
ed5cebf
Update Java version
calixtus Sep 25, 2023
afc4d67
Refine logging
koppor Sep 25, 2023
2f3203f
Fix compile error
koppor Sep 25, 2023
c771458
Add LuceneTest
koppor Sep 25, 2023
b795fa6
Update CHANGELOG.md
koppor Jan 11, 2024
29759bb
Move search classes to pdf package
LoayGhreeb May 23, 2024
b084538
Merge branch 'main' into update-lucene-branch
LoayGhreeb May 23, 2024
0dc1c2d
Move search classes to search package
LoayGhreeb May 24, 2024
d5c87df
rewriteRun
LoayGhreeb May 24, 2024
a0c3a71
Merge branch 'main' into update-lucene-branch
LoayGhreeb May 29, 2024
bfc33c8
Remove bibEntry from DocumentReader
LoayGhreeb May 31, 2024
17fd483
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 3, 2024
c0098c9
Rewrite LuceneIndexer
LoayGhreeb Jun 3, 2024
cebaa1c
Remove IndexingTaskManager
LoayGhreeb Jun 3, 2024
81a0988
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 3, 2024
14a612d
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 12, 2024
f3c5cfa
Separate Bib fields index and LinkedFiles index
LoayGhreeb Jun 17, 2024
50299b2
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 17, 2024
a12653d
Fix null LuceneManager in ExternalFilesEntryLinker
LoayGhreeb Jun 17, 2024
007898a
Save as action
LoayGhreeb Jun 17, 2024
c4e02d6
Clear linkedFiles indexer when fullText indexing is disabled in prefe…
LoayGhreeb Jun 17, 2024
c6faa35
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 17, 2024
0c0d6ba
remove comments
LoayGhreeb Jun 17, 2024
6b5e66a
get indexed files on update
LoayGhreeb Jun 17, 2024
4c23c4e
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 17, 2024
50a6db4
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 18, 2024
3c1c0ef
Add LUCENE_MANAGERS map for accessing managers by databaseContext.getUid
LoayGhreeb Jun 19, 2024
c2181ec
Move LuceneManager from search.indexing package to search
LoayGhreeb Jun 19, 2024
00ec1de
Fix wrong order for import
LoayGhreeb Jun 19, 2024
ad95628
Move SearchQuery to model package
LoayGhreeb Jun 19, 2024
4732d25
Fix issue with opening multiple unsaved libraries
LoayGhreeb Jun 19, 2024
9887362
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 23, 2024
c692b30
Pass LuceneManager down to the entry editor
LoayGhreeb Jun 23, 2024
27fdde1
Improve searching performance
LoayGhreeb Jun 24, 2024
9708b29
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 24, 2024
ab5388f
Change SearchFieldConstants to enum
LoayGhreeb Jun 25, 2024
9242516
More performance improvements for searching
LoayGhreeb Jun 25, 2024
2cc4f39
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 25, 2024
d8bc078
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jun 26, 2024
9219eec
Update FulltextSearchResultsTab.java
LoayGhreeb Jun 26, 2024
99938d9
Fix group union, intersection
LoayGhreeb Jun 26, 2024
d70342f
Fix backgroundtask
calixtus Jun 27, 2024
f9731d1
Merge remote-tracking branch 'LoayGhreeb/update-lucene-branch' into f…
calixtus Jun 27, 2024
bbf8d19
Fix subscriptions
calixtus Jun 27, 2024
8d6e06c
Remove lastSearchQueryLogic
calixtus Jun 27, 2024
fb3c097
Fix possible NPE
calixtus Jun 27, 2024
b8c6e9a
Fix searchTask check
calixtus Jun 27, 2024
7e75341
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jul 3, 2024
136225d
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jul 3, 2024
b13d81e
Remove sort by score flag
LoayGhreeb Jul 5, 2024
4f679de
Fix score column sorting
LoayGhreeb Jul 5, 2024
12c9869
Fix modifier buttons listener
LoayGhreeb Jul 5, 2024
d94a1b1
Add search rank column
LoayGhreeb Jul 8, 2024
3671fdf
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jul 8, 2024
cf271d5
hide search rank column from preferences
LoayGhreeb Jul 8, 2024
5b42e70
Add search_rank column to sort order by default
LoayGhreeb Jul 10, 2024
33cc770
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jul 10, 2024
8abee27
Update CHANGELOG.md
LoayGhreeb Jul 10, 2024
c30edfb
fix typo
LoayGhreeb Jul 10, 2024
2fe8e3b
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jul 11, 2024
cf49713
Change the order of the rank
LoayGhreeb Jul 11, 2024
bec28bf
Merge branch 'main' into update-lucene-branch
koppor Jul 15, 2024
bf94797
Merge branch 'main' into update-lucene-branch
LoayGhreeb Jul 26, 2024
4352e77
Merge branch 'update-lucene-branch' into LuceneSearch
LoayGhreeb Jul 28, 2024
3203439
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 4, 2024
d67b988
Use NGramAnalyzer for indexing
LoayGhreeb Aug 4, 2024
aa81985
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 5, 2024
aac90cd
Resolve conflicts
LoayGhreeb Aug 5, 2024
1ec38d5
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 6, 2024
f28af55
update search matches with lucene
LoayGhreeb Aug 6, 2024
17f834a
PreviewViewer highlighting with Lucene
LoayGhreeb Aug 7, 2024
f660551
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 7, 2024
76297a0
Delete IndexingTaskManager.java
LoayGhreeb Aug 7, 2024
6d4e992
SourceTab highlighting with Lucene
LoayGhreeb Aug 11, 2024
e71087e
Fix non-ASCII characters
LoayGhreeb Aug 12, 2024
f4d24f6
Extract query terms from search query
LoayGhreeb Aug 12, 2024
805a5a0
Highlight regex queries
LoayGhreeb Aug 12, 2024
2446ccd
return js highlight function
LoayGhreeb Aug 12, 2024
20d7096
Fix invalid search query throw exception
LoayGhreeb Aug 12, 2024
77a4c92
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 12, 2024
793dd59
Refactor Lucene indexer classes
LoayGhreeb Aug 12, 2024
1b1cdbb
Refactor linked files indexer
LoayGhreeb Aug 12, 2024
4e7defa
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 12, 2024
43c8d9d
Update search matches when entries are added or updated
LoayGhreeb Aug 13, 2024
f58b1e8
Remove preferences from ActionHelper
LoayGhreeb Aug 13, 2024
b8be4ee
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 13, 2024
09f3ea5
checkstyle
LoayGhreeb Aug 13, 2024
e47ba65
comment out search tests
LoayGhreeb Aug 13, 2024
a8f7d18
OpenRewrite
LoayGhreeb Aug 13, 2024
97ecff1
Fix Groups Parser/Serializer
LoayGhreeb Aug 13, 2024
87408a1
Localization
LoayGhreeb Aug 13, 2024
abd5652
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 14, 2024
b5a2774
Search groups
LoayGhreeb Aug 15, 2024
1fe163e
Merge remote-tracking branch 'upstream/main' into LuceneSearch
koppor Aug 19, 2024
3939064
Release `IndexSearcher` after completing search task
LoayGhreeb Aug 20, 2024
52b04e4
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 20, 2024
8c8becc
Checkstyle
LoayGhreeb Aug 20, 2024
4dea5f3
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 23, 2024
363f46b
Correct typo
LoayGhreeb Aug 25, 2024
78ab566
Remove GroupSearchQuery
LoayGhreeb Aug 25, 2024
210a824
Remove EventBus from LuceneManager and use BibDatabase eventBus
LoayGhreeb Aug 25, 2024
193d533
Fix number of matched entries in groups
LoayGhreeb Aug 25, 2024
4ca8afb
Fix search groups
LoayGhreeb Aug 25, 2024
9ca71c7
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 25, 2024
26a49d4
Localization
LoayGhreeb Aug 25, 2024
d26929e
Remove bib fields highlighter
LoayGhreeb Aug 26, 2024
e4c9d91
Pass LuceneManager to search groups
LoayGhreeb Aug 26, 2024
3400c92
Fix performance issues by caching matched entries
LoayGhreeb Aug 26, 2024
e4fe911
Update GroupDialogViewModelTest.java
LoayGhreeb Aug 26, 2024
707063a
Update main table matches
LoayGhreeb Aug 26, 2024
63cba32
Fix groups icon
LoayGhreeb Aug 26, 2024
fd531a6
Restore Search.g4 and GrammarBasedSearchRule
LoayGhreeb Aug 26, 2024
fcc8c9c
First version of search group migration
koppor Aug 26, 2024
660e354
Add groups field to the index
LoayGhreeb Aug 26, 2024
9d0d718
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 26, 2024
fca2f93
Merge branch 'LuceneSearch' of https://github.com/Jabref/jabref into …
LoayGhreeb Aug 26, 2024
c6c9065
Remove search rules
LoayGhreeb Aug 26, 2024
05aab8d
Localization
LoayGhreeb Aug 26, 2024
c19d01d
Add test cases
LoayGhreeb Aug 27, 2024
67c6c4d
Fix names
koppor Aug 27, 2024
ba660d4
Add some more functionality
koppor Aug 27, 2024
e46e0a2
Always add "all" prefix
koppor Aug 27, 2024
699e921
Add comment for alternative implementation
koppor Aug 27, 2024
f671f08
Mark library tab changed after migration
koppor Aug 27, 2024
3e6a179
Add another test for regular expression
koppor Aug 27, 2024
2018cea
Small fixes
koppor Aug 27, 2024
04105a8
Fix markBaseChanged
koppor Aug 27, 2024
cc3c002
Fix adding new entries did not update MatchCategory
LoayGhreeb Aug 28, 2024
909afe4
Fix searching for Non-ASCII characters
LoayGhreeb Aug 28, 2024
bfa1356
Fix escaping special characters
LoayGhreeb Aug 28, 2024
ec5bfbb
Fix tests
LoayGhreeb Aug 28, 2024
9efbf55
Add first draft of LatexToUnicodeFoldingFilter
koppor Aug 28, 2024
e95674a
Fix LatexToUnicodeFoldingFilter
LoayGhreeb Aug 28, 2024
02c8ca0
Remove LatexToUnicode from SearchQuery
LoayGhreeb Aug 28, 2024
7b95f8d
Localization
LoayGhreeb Aug 28, 2024
a0ff7fb
AllowedToUseLogic
LoayGhreeb Aug 28, 2024
eb989f4
Merge branch 'main' into LuceneSearch
koppor Aug 28, 2024
b55ab31
Update CHANGELOG.md
koppor Aug 28, 2024
0b7284d
Use sentence case for search result heading
koppor Aug 28, 2024
37c8325
Add CHANGELOG for change in JabRefFrameViewModel
koppor Aug 28, 2024
8faad33
Add more changes to CHANGELOG.md
koppor Aug 28, 2024
cd71f11
Add ADR-0038
koppor Aug 28, 2024
beb3881
Rename "SCORE" to "MATCH_SCORE"
koppor Aug 28, 2024
59a5e54
Add link to ADR-0038
koppor Aug 28, 2024
bc28532
Add another CHANGELOG.md entry
koppor Aug 28, 2024
85f4a4b
Add CHANGELOG.md entry
koppor Aug 28, 2024
d22ef7b
Revert change of filename
koppor Aug 28, 2024
9ca8416
Add JavaDoc comment
koppor Aug 28, 2024
4ebb256
Trying to find better names
koppor Aug 28, 2024
e64242d
Discard changes to src/main/resources/tinylog.properties
koppor Aug 28, 2024
f6b3d94
Remove commented out code
koppor Aug 28, 2024
7d2834b
Remove obsolete testing class
koppor Aug 28, 2024
033226c
Remove obsolete test
koppor Aug 28, 2024
5d0118d
Discard changes to src/test/resources/tinylog-test.properties
koppor Aug 28, 2024
78264d7
Remove completely disabled code
koppor Aug 28, 2024
6616c2a
Merge branch 'LuceneSearch' of github.com:JabRef/jabref into LuceneSe…
koppor Aug 28, 2024
73890f1
Merge branch 'main' into LuceneSearch
koppor Aug 28, 2024
3dfd01e
Rename "all" to "any"
LoayGhreeb Aug 28, 2024
e2c430b
Catch thrown exception
LoayGhreeb Aug 28, 2024
05b6270
Remove groups field from the default field
LoayGhreeb Aug 28, 2024
cde42f0
Remove SearchGroupsListener
LoayGhreeb Aug 29, 2024
5cc1312
Update Benchmarks.java
LoayGhreeb Aug 29, 2024
5818452
Update module-info.java
LoayGhreeb Aug 29, 2024
ff56ea9
Fixes from code review on LibraryTab
LoayGhreeb Aug 29, 2024
2310625
Remove regex button from search bar
LoayGhreeb Aug 29, 2024
f369b09
Use BibEntry.getId instead of System.identityHashCode
LoayGhreeb Aug 29, 2024
27ed105
Add BibEntry index map
LoayGhreeb Aug 29, 2024
a1461e5
Readd option
koppor Aug 29, 2024
53e274d
Add `@ADR` annotation
koppor Aug 29, 2024
d4754ca
Add some comment
koppor Aug 29, 2024
71732a6
One more annotation
koppor Aug 29, 2024
f4a5567
Add CHANGELOG.md entry
koppor Aug 29, 2024
f3f454c
One more annotation
koppor Aug 29, 2024
a23e047
Add CHANGELOG.md entry
koppor Aug 29, 2024
edfb3cc
Revert "Add BibEntry index map"
LoayGhreeb Aug 29, 2024
94b27eb
Use binary search to find the index of the entry
LoayGhreeb Aug 29, 2024
edb2ab6
openrewrite
LoayGhreeb Aug 29, 2024
24cf9f7
Tests for LinkedFilesIndexer
LoayGhreeb Aug 29, 2024
c3c9d12
Fix DatabaseSearcher
LoayGhreeb Aug 29, 2024
e3c3256
LocalizationConsistencyTest
LoayGhreeb Aug 29, 2024
12ff246
DatabaseSearcherWithBibFilesTest
LoayGhreeb Aug 29, 2024
36ee112
Fix typo in CHANGELOG.md
koppor Aug 29, 2024
15ed52b
Fix typo
LoayGhreeb Aug 30, 2024
cd6e55f
Use parameterized test for DatabaseSearcherTest
LoayGhreeb Aug 30, 2024
df5d7c1
Fix DatabaseSearcherWithBibFiles tests
LoayGhreeb Aug 30, 2024
4872dc5
Fix exportMatches test
LoayGhreeb Aug 30, 2024
bb90047
Merge branch 'main' into LuceneSearch
LoayGhreeb Aug 30, 2024
b12fa56
Remove regex check box from search groups dialog
LoayGhreeb Aug 30, 2024
1351add
JavaDoc
LoayGhreeb Aug 30, 2024
a8a1c2a
Fix SearchGroups test
LoayGhreeb Aug 30, 2024
d20cf5c
Remove closeAndWait methods and use CurrentThreadTaskExecutor
LoayGhreeb Aug 31, 2024
0957707
Fix architecture test
LoayGhreeb Sep 1, 2024
f923502
Allow to use logic
LoayGhreeb Sep 1, 2024
6b6bca3
Add debug logging for search
LoayGhreeb Sep 1, 2024
efb5324
Add more logging
LoayGhreeb Sep 1, 2024
48aa091
Assert with containsInAnyOrder
LoayGhreeb Sep 1, 2024
d4b5e8a
Fix DatabaseSearcher test
LoayGhreeb Sep 1, 2024
48fe7ca
Global search dialog
LoayGhreeb Sep 1, 2024
bb1d8c5
Merge branch 'main' into LuceneSearch
LoayGhreeb Sep 1, 2024
68d1df8
Rename method
LoayGhreeb Sep 1, 2024
1005685
Improve code quality
LoayGhreeb Sep 2, 2024
84a2754
Use non-static preferences variables
LoayGhreeb Sep 2, 2024
a8a845f
Update CHANGELOG.md
LoayGhreeb Sep 2, 2024
d6fbf55
Delete SearchGroupTest.java
LoayGhreeb Sep 2, 2024
eeadaee
fix typo
LoayGhreeb Sep 2, 2024
0959592
fix indentation
LoayGhreeb Sep 2, 2024
29d2ad3
Update matchedEntries on the UI thread
LoayGhreeb Sep 2, 2024
0a7b92f
Discard changes to src/main/java/org/jabref/gui/importer/actions/GUIP…
LoayGhreeb Sep 2, 2024
0ecfae4
Merge branch 'main' into LuceneSearch
LoayGhreeb Sep 2, 2024
5bcb82d
Fix LoayGhreeb#12
LoayGhreeb Sep 2, 2024
09d5148
Sync search flags between search bar and global search bar
LoayGhreeb Sep 2, 2024
a9a8a7c
Move VERSION_6_0_ALPHA const to SearchGroupsMigrationAction
LoayGhreeb Sep 2, 2024
146e3f7
Refactor LuceneSearcher
LoayGhreeb Sep 2, 2024
558b1b3
Use linked files analyzer for highlighting full-text results
LoayGhreeb Sep 2, 2024
54fd783
Merge branch 'main' into LuceneSearch
LoayGhreeb Sep 2, 2024
e6f3b5d
Fix line break
LoayGhreeb Sep 2, 2024
95458d3
Fix tests
LoayGhreeb Sep 2, 2024
e5665ce
Use EnglishAnalyzer for indexing/searching linked files
LoayGhreeb Sep 2, 2024
ce21f4a
Ask to wait for linked files indexing on shutdown
LoayGhreeb Sep 4, 2024
cf92f0a
Merge branch 'main' into LuceneSearch
LoayGhreeb Sep 4, 2024
6dbc187
Use EdgeNGram instead of NGram
LoayGhreeb Sep 4, 2024
c9d8230
Return comment
LoayGhreeb Sep 4, 2024
fa8344b
Update CHANGELOG.md
LoayGhreeb Sep 4, 2024
5f05f4a
Merge branch 'main' into LuceneSearch
LoayGhreeb Sep 4, 2024
ab87e24
Merge branch 'main' into LuceneSearch
LoayGhreeb Sep 4, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into update-lucene-branch
  • Loading branch information
LoayGhreeb authored Jul 3, 2024
commit 136225d32333946ff351009b72a992d3cde467cd

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.