Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encode hotwords in C++ side #828

Merged
merged 17 commits into from
May 20, 2024
Merged

Encode hotwords in C++ side #828

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
84572e8
Encode hotwords in C++ side
pkufool May 2, 2024
65f81d2
encode hotwords for online transducer
pkufool May 6, 2024
f24b998
minor fixes
pkufool May 6, 2024
589ca83
Skipping oov hotwords & fix byte bpe token
pkufool May 9, 2024
78e8700
Merge with master
pkufool May 9, 2024
9e0d518
Add script to export bpe vocab file
pkufool May 10, 2024
2dd3aa6
jni, kotlin, python api
pkufool May 10, 2024
bb83549
Fix docs
pkufool May 15, 2024
7097e59
Merge with master
pkufool May 15, 2024
db5c048
Minor fixes
pkufool May 15, 2024
a05be65
Fix simple-sentencepiece cmake
pkufool May 16, 2024
ac29295
Fix pthread in android; kotlin api
pkufool May 16, 2024
8296b8b
fix ci
pkufool May 17, 2024
ae45431
Fix ci
pkufool May 17, 2024
171b854
Fix deps
pkufool May 17, 2024
76ee69b
Fix recent git-lfs update issue
pkufool May 17, 2024
f901d5a
Fix cpp style
pkufool May 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix pthread in android; kotlin api
  • Loading branch information
@pkufool
pkufool committed May 16, 2024
commit ac2929548e2ef272bc904c5d64217cbbd3eb9cc8
16 changes: 8 additions & 8 deletions cmake/simple-sentencepiece.cmake
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,18 +1,18 @@
function(download_simple_sentencepiece)
include(FetchContent)

set(simple-sentencepiece_URL "https://github.com/pkufool/simple-sentencepiece/archive/refs/tags/v0.5.tar.gz")
set(simple-sentencepiece_URL2 "https://hub.nauu.cf/pkufool/simple-sentencepiece/archive/refs/tags/v0.5.tar.gz")
set(simple-sentencepiece_HASH "SHA256=10d3c79adae00073e7eb739271fe71ecbdfc6506b2a3124bad5651afc6f5b1cb")
set(simple-sentencepiece_URL "https://github.com/pkufool/simple-sentencepiece/archive/refs/tags/v0.6.tar.gz")
set(simple-sentencepiece_URL2 "https://hub.nauu.cf/pkufool/simple-sentencepiece/archive/refs/tags/v0.6.tar.gz")
set(simple-sentencepiece_HASH "SHA256=8b0d8afab5a76e4921d244dccfb0a1809c6951f617d5cf38cda1536e7c07b3c8")

# If you don't have access to the Internet,
# please pre-download simple-sentencepiece
set(possible_file_locations
$ENV{HOME}/Downloads/simple-sentencepiece-0.5.tar.gz
${CMAKE_SOURCE_DIR}/simple-sentencepiece-0.5.tar.gz
${CMAKE_BINARY_DIR}/simple-sentencepiece-0.5.tar.gz
/tmp/simple-sentencepiece-0.5.tar.gz
/star-fj/fangjun/download/github/simple-sentencepiece-0.5.tar.gz
$ENV{HOME}/Downloads/simple-sentencepiece-0.6.tar.gz
${CMAKE_SOURCE_DIR}/simple-sentencepiece-0.6.tar.gz
${CMAKE_BINARY_DIR}/simple-sentencepiece-0.6.tar.gz
/tmp/simple-sentencepiece-0.6.tar.gz
/star-fj/fangjun/download/github/simple-sentencepiece-0.6.tar.gz
)

foreach(f IN LISTS possible_file_locations)
Expand Down
4 changes: 2 additions & 2 deletions sherpa-onnx/kotlin-api/OfflineRecognizer.kt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ data class OfflineModelConfig(
var provider: String = "cpu",
var modelType: String = "",
var tokens: String,
var modelingUnit: String,
var bpeVocab: String,
var modelingUnit: String = "",
var bpeVocab: String = "",
)

data class OfflineRecognizerConfig(
Expand Down
Loading