Pinned Loading

1. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 4.1k 392

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 19k 3.1k

3. LMCache/LMCache LMCache/LMCache Public

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python 5.5k 637

4. foyer-rs/foyer foyer-rs/foyer Public

   Hybrid in-memory and disk cache in Rust

   Rust 1.4k 61

5. datenlord/datenlord datenlord/datenlord Public

   DatenLord, Computing Defined Storage, an application-orientated, cloud-native distributed storage system

   Rust 907 92