Skip to content

Remove camel case tokenization from repo indexer #7733

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
Aug 6, 2019
Merged

Remove camel case tokenization from repo indexer #7733

Changes from 6 commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
a8d4e40
Make repository indexer tokenize by camel case selectable
Aug 3, 2019
e13dc55
Merge branch 'master' of https://github.com/go-gitea/gitea into camel…
Aug 4, 2019
ea1f22d
Revert "Make repository indexer tokenize by camel case selectable"
Aug 4, 2019
6a443bf
Remove app.ini setting, permanently remove camel case tokenizer
Aug 4, 2019
0b045e4
Merge branch 'master' into camelcaseselectable
lunny Aug 5, 2019
b222c0e
Increase repoIndexerLatestVersion to force indexes to be rebuilt
Aug 5, 2019
e316cf5
Merge branch 'master' into camelcaseselectable
lafriks Aug 5, 2019
a258ae2
Merge branch 'master' of https://github.com/go-gitea/gitea into camel…
Aug 5, 2019
2e4479c
Changes introduced by the commmand make vendor
Aug 6, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 2 additions & 3 deletions modules/indexer/repo.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,6 @@ import (

"github.com/blevesearch/bleve"
"github.com/blevesearch/bleve/analysis/analyzer/custom"
"github.com/blevesearch/bleve/analysis/token/camelcase"
"github.com/blevesearch/bleve/analysis/token/lowercase"
"github.com/blevesearch/bleve/analysis/token/unique"
"github.com/blevesearch/bleve/analysis/tokenizer/unicode"
Expand All @@ -24,7 +23,7 @@ const (
repoIndexerAnalyzer = "repoIndexerAnalyzer"
repoIndexerDocType = "repoIndexerDocType"

repoIndexerLatestVersion = 1
repoIndexerLatestVersion = 2
)

// repoIndexer (thread-safe) index for repository contents
Expand Down Expand Up @@ -111,7 +110,7 @@ func createRepoIndexer(path string, latestVersion int) error {
"type": custom.Name,
"char_filters": []string{},
"tokenizer": unicode.Name,
"token_filters": []string{unicodeNormalizeName, camelcase.Name, lowercase.Name, unique.Name},
"token_filters": []string{unicodeNormalizeName, lowercase.Name, unique.Name},
}); err != nil {
return err
}
Expand Down