NLTK Data

A collection of corpora for named entity recognition (NER) and entity recognition tasks. These annotated datasets cover a variety of languages, domains and entity types.

Data repository for pretrained NLP models and NLP corpora.

Official source for spanish Language Models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

CrossNER: Evaluating Cross-Domain Named Entity Recognition (AAAI-2021)

The Self-dialogue Corpus - a collection of self-dialogues across music, movies and sports

Unannotated Spanish 3 Billion Words Corpora

Automatic categorization of documents, consists in assigning a category to a text based on the information it contains. We'll follow different approach of Supervised Machine Learning.

[NLPCC 2023] CCAE: A Corpus of Chinese-based Asian Englishes

Named Entity Recognition for biomedical entities

Official source for Spanish pretrained biomedical and clinical language models and resources made @ BSC-TEMU within the "Plan de las Tecnologías del Lenguaje" (Plan-TL).

Extract corpora from Wikipedia dumps

repo for Tibetan corpora

Demeuk is a simple tool to clean up corpora (like dictionaries) or any dataset containing plain text strings.

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

The Potsdam Twitter Sentiment Corpus

OPUS (opus.nlpl.eu) Python3 API

Measure the similarity of text corpora for 74 languages

Multilingual text corpus designed to study multilingual and cross-lingual natural language understanding (NLU) models and the strategies of localization of virtual assistants

Scripts for building a geo-located web corpus using Common Crawl data