An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
-
Updated
Sep 4, 2026 - Python
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
To associate your repository with the deepspeed-library topic, visit your repo's landing page and select "manage topics."