Popular repositories Loading

1. TensorRT-LLM TensorRT-LLM Public

   Forked from NVIDIA/TensorRT-LLM

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++

2. fastcogvideox fastcogvideox Public

   Python

3. FastVideo FastVideo Public

   Forked from hao-ai-lab/FastVideo

   FastVideo is a unified framework for accelerated video generation.

   Python

4. verl verl Public

   Forked from verl-project/verl

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python

5. TensorRT-Model-Optimizer TensorRT-Model-Optimizer Public

   Forked from NVIDIA/Model-Optimizer

   A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment…

   Python

6. aiconfigurator aiconfigurator Public

   Forked from ai-dynamo/aiconfigurator

   Offline optimization of your disaggregated Dynamo graph

   Python