TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

The simplest, fastest repository for training/finetuning medium-sized GPTs.

AI and Machine Learning with Kubeflow, Amazon EKS, and SageMaker

Assignment 1 for the CMU 15418 Course

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

Distributed training framework for TensorFlow, Keras, and PyTorch.

Notebooks for learning deep learning

Dive into Deep Learning: an interactive deep learning book with code, math, and discussions

Learn how to design large-scale systems. Prep for the system design interview. Includes Anki flashcards.

A high performance and general PS framework for distributed training

A common bricks library for building scalable and portable distributed machine learning.

Kubernetes-native Deep Learning Framework

A booklet on machine learning systems design with exercises

NLP made easy

Gluon CV Toolkit

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Matrix Shadow:Lightweight CPU/GPU Matrix and Tensor Template Library in C++/CUDA for (Deep) Machine Learning

https://beta.mxnet.io/

Gradient based hyperparameter optimization & meta-learning package for TensorFlow

A Gluon implementation of Mnasnet

A Tool for Automatic Parallelization of Deep Learning Training in Distributed Multi-GPU Environments.

RFC for common in-memory tensor structure and operator interface for deep learning system

An Open Source Machine Learning Framework for Everyone

MPI programming lessons in C and executable code examples