Pinned Loading

1. PaddlePaddle/Paddle PaddlePaddle/Paddle Public

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++ 22.2k 5.6k

2. PaddlePaddle/PaddleNLP PaddlePaddle/PaddleNLP Public

   👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search…

   Python 12.1k 2.9k

3. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++ 8.6k 981

4. LLMServe/DistServe LLMServe/DistServe Public

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook 351 38

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. PaddlePaddle/CINN PaddlePaddle/CINN Public archive

   Compiler Infrastructure for Neural Networks

   C++ 143 115