A Python library transfers PyTorch tensors between CPU and NVMe

Large-scale model inference.

Scalable PaLM implementation of PyTorch

Optimizing Protein Structure Prediction Model Training and Inference on GPU Clusters

Sky Computing, a new way for federated learning

Performance benchmarking with ColossalAI

Examples of training models with hybrid parallelism using ColossalAI

Colossal-AI: A Unified Deep Learning System for Large-Scale Parallel Training

Reference models and tools for Cloud TPUs.

A CUDNN minimal deep learning training code sample using LeNet.