Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

Create and manage Amazon SageMaker HyperPod clusters, run distributed model training

Experimental scripts for Amazon SageMaker HyperPod

Infrastructure deployment automation of SageMaker HyperPod clusters based on EKS and SLURM orchestration and Protein Language ESM-2 model training job definitions including NVIDIA BioNemo