Skip to content

spxia/WeTextProcessing

 
 

Repository files navigation

Text Normalization & Inverse Text Normalization

1. How To Use

$ python normalize.py --text "text to be normalized"
$ python inverse_normalize.py --text "text to be denormalized"

2. TN Pipeline

Please refer to TN.README

3. ITN Pipeline (Coming soon...)

Please refer to ITN.README

Acknowledge

  1. Thank the authors of foundational libraries like OpenFst & Pynini.
  2. Thank NeMo team & NeMo open-source community.
  3. Thank Zhenxiang Ma, Jiayu Du, and SpeechColab organization.
  4. Referred Pynini for reading the FAR, and printing the shortest path of a lattice in the C++ runtime.
  5. Referred TN of NeMo for the data to build the tagger graph.
  6. Referred ITN of chinese_text_normalization for the data to build the tagger graph.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 50.0%
  • C++ 38.6%
  • CMake 9.6%
  • C 1.8%