Data Preparation for Large Language Models — a curated companion to our JCST 2026 survey. Covers Pre-training, Continual Pre-training, and Post-training (SFT/RLHF/RLAIF) across collection, filtering, dedup, generation, evaluation.
nlp awesome deep-learning survey awesome-list data-preparation sft pretraining data-centric-ai large-language-models llm rlhf instruction-tuning rlaif continual-pretraining
-
Updated
Apr 28, 2026 - Shell