中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调，给出三元组信息抽取微调示例。

pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。

simpleT5 is built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train your T5 models.

[Pytorch] Unofficial Implementation of "Recommender Systems with Generative Retrieval"

Implement Question Generator with SOTA pre-trained Language Models (RoBERTa, BERT, GPT, BART, T5, etc.)

📚 Unearth the Core of Knowledge in Minutes 📓

A extension of Transformers library to include T5ForSequenceClassification class.

Abstractive text summarization by fine-tuning seq2seq models.

This repository contains the data and code for the paper "Diverse Text Generation via Variational Encoder-Decoder Models with Gaussian Process Priors" (SPNLP@ACL2022)

Repository about small code models

Code Implementation for "NASH: A Simple Unified Framework of Structured Pruning for Accelerating Encoder-Decoder Language Models" (EMNLP 2023)

T5 Fine-tuning on SQuAD Dataset for Question Generation

Official repository of Generating Multiple-Length Summaries via Reinforcement Learning for Unsupervised Sentence Summarization [EMNLP'22 Findings]

T5 (Text-to-Text Transformer Model) for Farsi.

A enhanced Open Dialogue Context Generator supported by General Language Model Pretraining with Autoregressive Blank Infilling

A repository for my Diploma Thesis; "Semantic communications framework with Transformer based models"

LongT5-based model pre-trained on a large amount of unlabeled Vietnamese news texts and fine-tuned with ViMS and VMDS collections

A python script to fine-tune pre-trained models for text generation

追一科技开源的t5-pegasus的Pytorch实现

Building this project to generate MCQ Questions from any type of text and generate answers and distractors for it.