meta-pytorch / autoparallel Public

Notifications You must be signed in to change notification settings
Fork 9
Star 31

An experimental implementation of compiler-driven automatic sharding of models across a given device mesh.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 150 Commits
.github/workflows		.github/workflows
autoparallel		autoparallel
examples		examples
mast		mast
tests		tests
.flake8		.flake8
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
CLAUDE.md		CLAUDE.md
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
README.md		README.md
pyproject.toml		pyproject.toml
requirements-test.txt		requirements-test.txt

Repository files navigation

AutoParallel

WARNING: Highly under development!

This currently works on PyTorch 2.8.0.dev20250506.

Installing it

pip install git+ssh://git@github.com/pytorch-labs/autoparallel.git

Developing it

cd autoparallel
pip install -e .

Modified Python files will be reflected immediately.

Run linter before submitting the PR

pip install pre-commit
pre-commit run --all-files

If you got An unexpected error has occurred: ... 'python3.11'), try modify .pre-commit-config.yaml/language_version: python3.11 to match your python version.