Ongoing research training transformer models at scale

The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）