Popular repositories Loading

1. EAGLE EAGLE Public

   Forked from SafeAILab/EAGLE

   Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3.

   Python

2. AngelSlim AngelSlim Public

   Forked from Tencent/AngelSlim

   Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

   Python

3. speculators speculators Public

   Forked from vllm-project/speculators

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python