Light-weight tool for normalizing whitespace and accurately tokenizing words (no regex). Multiple natural languages supported. Useful for scrapping, machine learning, and data analysis.
-
Updated
Oct 29, 2021 - Python
#
noregex
Here are 3 public repositories matching this topic...
Improve this page
Add a description, image, and links to the noregex topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the noregex topic, visit your repo's landing page and select "manage topics."