Pinned Loading

1. hpcaitech/ColossalAI hpcaitech/ColossalAI Public

   Making large AI models cheaper, faster and more accessible

   Python 39k 4.3k

2. Tencent/TurboTransformers Tencent/TurboTransformers Public

   a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

   C++ 1.5k 199

3. xdit-project/xDiT xdit-project/xDiT Public

   xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

   Python 1.1k 104

4. Tencent/PatrickStar Tencent/PatrickStar Public

   PatrickStar enables Larger, Faster, Greener Pretrained Models for NLP and democratizes AI for everyone.

   Python 751 57

5. LLMSpeculativeSampling LLMSpeculativeSampling Public

   Fast inference from large lauguage models via speculative decoding

   Python 613 63

6. long-context-attention long-context-attention Public

   USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

   Python 389 28