Contributors Forks Stargazers Issues MIT License LinkedIn

zernlp

A Natural Language Processing (NLP) Library for Filipino
Explore the docs »

Report Bug · Request Feature

Table of Contents

1. About The Project
2. Installation
3. Usage
4. Roadmap
5. Contributing
6. License
7. Contact
8. Acknowledgments

About The Project

zernlp is a user-friendly Python library designed to provide a comprehensive set of tools and algorithms for Natural Language Processing (NLP) tasks. Whether you are a researcher, data scientist, or developer working on language-related projects, zernlp offers a wide range of functionalities to process and analyze human language data efficiently for texts written in Filipino.

(back to top)

Installation

1. To start using zernlp, you can easily install it via pip:

   pip install zernlp

(back to top)

Usage

from zernlp.tokenizers import sentence_tokenizer, tokenizer

text = "Ito'y isang halimbawa ng paggamit sa zernlp para sa pag-tokenize ng isang pangungusap."

# ipasa ang text
sentences = sentence_tokenizer(text)
tokens = tokenizer(text)

for token in tokens:
  print(tokens)

for sentence in sentences:
  print(sentences)

(back to top)

Roadmap

• [ ]Tokenization: Efficiently split text into individual words or tokens, catering the Filipino language and tokenization rules.
• [ ]Lemmatization and Stemming: Reduce words to their base or root form for better information retrieval and analysis.
• [ ]Part-of-Speech (POS) Tagging: Assign grammatical tags to words, enabling linguistic analysis and information extraction.
• [ ]Named Entity Recognition (NER): Identify and categorize entities like persons, locations, and organizations in the text.
• [ ]Dependency Parsing: Analyze the grammatical structure of sentences and identify the relationships between words.

See the open issues for a full list of proposed features (and known issues).

(back to top)

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

1. Fork the Project
2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
3. Commit your Changes (git commit -m 'Add some AmazingFeature')
4. Push to the Branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

(back to top)

License

Distributed under the MIT License. See LICENSE.txt for more information.

(back to top)

Contact

Kenneth Tegrado - kategrado@up.edu.ph

Project Link: https://github.com/kennethtegrado/zernlp

(back to top)

Acknowledgments

(back to top)