Pinned Loading

1. verl verl Public

   Forked from volcengine/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python

2. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 53.8k 9.1k

3. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.5k 2.5k

4. inclusionAI/AReaL inclusionAI/AReaL Public

   Distributed RL System for LLM Reasoning

   Python 2.1k 130

5. SafeAILab/EAGLE SafeAILab/EAGLE Public

   Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.

   Python 1.4k 189

6. sgl-project/SpecForge sgl-project/SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 264 37