What's Changed
- Tokenization performance improvements.
- Support for latest Hugging Face tokenization JSON format (transformers>=4.45).
- Unigram tokenization model support.
- OpenCV dependency removed from C API build.
New Contributors
- @vraspar made their first contribution in #776
- @zhipenghan made their first contribution in #795
- @legendof-selda made their first contribution in #803
Full Changelog: v0.12.0...v0.13.0
Contributors
zhipenghan, legendof-selda, and vraspar