Pinned Loading

1. transformers-in-supercomputers transformers-in-supercomputers Public

   Transformers training in a supercomputer with the 🤗 Stack and Slurm

   Python 13

2. MN5-Distributed-PyTorch MN5-Distributed-PyTorch Public

   Entry point for developing distributed applications with PyTorch, Slurm and Singularity on MareNostrum5 Supercomputer

   Shell 1

3. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Debugging Megatron. 3D Parallelism, models, training and more!

   Python 2

4. nanotron nanotron Public

   Forked from swiss-ai/nanotron

   Minimalistic large language model 3D-parallelism training

   Python