Pinned Loading

1. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 83.4k 22.5k

2. FasterTransformer FasterTransformer Public

   Forked from NVIDIA/FasterTransformer

   Transformer related optimization, including BERT, GPT

   C++

3. apache/tvm apache/tvm Public

   Open deep learning compiler stack for cpu, gpu and specialized accelerators

   Python 11.7k 3.5k

4. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

5. facebookincubator/gloo facebookincubator/gloo Public

   Collective communications library with various primitives for multi-machine training.

   C++ 1.2k 304

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python