We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 089f31a commit 79e44c1Copy full SHA for 79e44c1
.ci/docker/common/install_conda.sh
@@ -43,7 +43,7 @@ install_pip_dependencies() {
43
pip_install -r /opt/conda/requirements.txt
44
pip_install -r /opt/conda/requirements-flux.txt
45
pip_install -r /opt/conda/requirements-vlm.txt
46
- pip_install -r /opt/conda/requirements-transformers-backend.txt
+ pip_install -r /opt/conda/requirements-transformers-modeling-backend.txt
47
popd
48
}
49
torchtitan/experiments/transformers_modeling_backend/README.md
@@ -1,4 +1,6 @@
1
-# Huggingface Transformers backend
+# Huggingface Transformers Modeling backend
2
+
3
+This enables HF transformers models to be trained with `4D parallelism + torch.compile`
4
5
## Quick start
6
0 commit comments