Machine Translation for Africa

A repository for publicly/freely available Natural Language Processing (NLP) datasets for African languages.

Syllable-aware BPE tokenizer for the Amharic language (አማርኛ) – fast, accurate, trainable.

Yorùbá language training text for NLP, ASR and TTS tasks

SemEval2024-task 11: Bridging the Gap in Text-Based Emotion Detection

AfriSenti-SemEval Shared Task 12: Sentiment Analysis for African languages : https://afrisenti-semeval.github.io/

Masakhane Web is a translation web application for solely African Languages.

This is a repository for NaijaSenti. A Lacuna Funded Project for the development of sentiment corpus for four Nigerian languages: Igbo, Hausa, Yoruba and Pidgin.

AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.

Automatic Diacritic Restoration of Yorùbá language Text

First comprehensive survey of NLP work carried out in Senegalese languages covering various tasks + Applications in the social sciences.

Cross-lingual Language Model (XLM) pretraining and Model-Agnostic Meta-Learning (MAML) for fast adaptation of deep networks

Ìrànlọ́wọ́ is a utility library for analysis & (pre)processing of Yorùbá text → https://pypi.org/project/iranlowo

stoplists for African languages generated from the ASP corpus

Introduction to "Tencent’s Multilingual Machine Translation System for WMT22 Large-Scale African Languages".

Website that hosts the African Voices projects. Users can download datasets and synthesizers, and synthesize speech in African languages

The dataset contains editions from the South African government magazine Vuk'uzenzele. Data was scraped from PDFs that have been placed in the data/raw folder. The PDFS were obtained from the Vuk'uzenzele website.

Official DSFSI Public Datasets Registry - Comprehensive catalog of 50+ datasets for South African & African languages. Includes speech recognition, NLP, terminology, health, legal & financial data across HuggingFace, GitHub, Zenodo & more.

A Python based utility for Swahili and English number to words conversion.

This repo contains LUO corpus for Named Entity Recognition. The text comes from the news domain and was scrapped from Radio Ramogi.