[NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner"

Repository for My HuggingFace Natural Language Processing Projects

🚀 Unified NLP Pipelines for Language Models

PyTorch implementation for "Training and Inference on Any-Order Autoregressive Models the Right Way", NeurIPS 2022 Oral, TPM 2023 Best Paper Honorable Mention

11th place solution of NeurIPS 2024 - Predict New Medicines with BELKA competition on Kaggle: https://www.kaggle.com/competitions/leash-BELKA

Implementation of Transformer Encoders / Masked Language Modeling Objective

Official implementation of 'Masked Language Modeling Becomes Conditional Density Estimation for Tabular Data Synthesis' (MaCoDE) with pytorch (AAAI 2025 accepted paper).

Measuring Biases in Masked Language Models for PyTorch Transformers. Support for multiple social biases and evaluation measures.

The default way to fine-tune BERT is wrong. Here is why

fork of NeoBERT refactored for easy pretraining & arch experiments

Transformer for Automatic Speech Recognition

Continue T5 MLM pre-training on verbalized ConceptNet and fine-tune for commonsense question-answering

Code for the publication of WWW'22

Repository of artifacts for the BERTology manuscript

Evaluation of zero-shot classification models on Turkish datasets.

Production-style transformer explainability platform extending CS50AI Attention with BERT masked-token prediction, attention maps, financial NLP, embeddings, FastAPI, Streamlit, Docker, tests, offline-safe demos, model comparison, token insights, and deploy-ready docs.

Pre-training a Transformer from scratch.

External Knowledge Infusion using INCIDecoder into BERT for Chemical Mapping

Frozen KV Context for Mixture-of-Recursions on a Modernized BERT