A Datacenter Scale Distributed Inference Serving Framework

A colorful VSCode theme, support light or dark mode, with medium brightness and low saturation.

Maple Mono: Open source monospace font with round corner, ligatures and Nerd-Font for IDE and terminal, fine-grained customization options. 带连字和控制台图标的圆角等宽字体，中英文宽度完美2:1，细粒度的自定义选项

AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.

SGLang is a fast serving framework for large language models and vision language models.

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

DeepEP: an efficient expert-parallel communication library

FlashMLA: Efficient MLA decoding kernels

🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".

Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .

Staggeringly powerful macOS desktop automation with Lua

主要记录大语言大模型（LLMs） 算法（应用）工程师相关的知识及面试题

A simple Python Pydantic model for Honkai: Star Rail parsed data from the Mihomo API.

📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).

Acceptance rates for the major AI conferences

Material for gpu-mode lectures

📚 [译] ApacheCN C/C++ 译文集

🧑‍🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga…

Puzzles for learning Triton

Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

现代C++并发编程教程

Mastering Bitcoin 2nd Edition 精通比特币（第二版）-- 区块链编程

Tesseract Open Source OCR Engine (main repository)

Mastering Bitcoin 3rd Edition - Programming the Open Blockchain

Web3黑话汇总（黑宝书）

Roadmap of learning blockchain technology and business knowledge summarized by ZJUBCA（浙大区块链协会总结的区块链知识学习路线）

⛄ Possibly the smallest compiler ever