Popular repositories Loading

1. suture-stream-repair suture-stream-repair Public

   Ultra-low-latency reverse proxy that repairs truncated & malformed JSON in LLM streaming responses (OpenAI, Anthropic, Vertex AI, Bedrock) — fixes JSONDecodeError / serde_json EOF on truncated tool…

   Rust 3 1

2. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

3. sglang-omni sglang-omni Public

   Forked from sgl-project/sglang-omni

   SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models

   Python

4. slime slime Public

   Forked from THUDM/slime

   slime is an LLM post-training framework for RL Scaling.

   Python

5. miles miles Public

   Forked from radixark/miles

   Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.

   Python