mid-training

Here are 4 public repositories matching this topic...

A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.

training ai distributed infra lora wan diffusion vla vlm dit sft megatron pretraining llm mid-training

Revisiting Mid-training in the Era of Reinforcement Learning Scaling

rl llama reasoning post-training pre-training llm qwen verl mid-training

[𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models

Open catalog of datasets used to train and align LLMs across pretraining, mid-training, and post-training.

data datasets datahub post-training pretraining llm mid-training

Add a description, image, and links to the mid-training topic page so that developers can more easily learn about it.

To associate your repository with the mid-training topic, visit your repo's landing page and select "manage topics."