Skip to content

Commit

Permalink
update fedml dockerfile and jenkinsfile.
Browse files Browse the repository at this point in the history
  • Loading branch information
alexliang committed Oct 25, 2022
1 parent dfa5319 commit 37c544b
Show file tree
Hide file tree
Showing 3 changed files with 9 additions and 3 deletions.
5 changes: 5 additions & 0 deletions devops/scripts/build-fedml-docker.sh
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,13 @@ OUTPUT_IMAGE=fedml/fedml:latest-torch1.12.1-cuda11.3-cudnn8-devel
NVIDIA_BASE_IMAGE=nvidia/cuda:11.3.1-cudnn8-devel-ubuntu18.04
PYTORCH_EXTRA_INDEX_URL=https://download.pytorch.org/whl/cu113
PYTORCH_GEOMETRIC_URL=https://data.pyg.org/whl/torch-1.12.0+cu113.html
export FEDML_VERSION=`cat python/setup.py |grep version= |awk -F'=' '{print $2}' |awk -F',' '{print $1}'|awk -F'"' '{print $2}'`
CURRENT_IMAGE=fedml/fedml:${FEDML_VERSION}-torch1.12.1-cuda11.3-cudnn8-devel

cd ./docker
bash build-docker.sh $ARCH $OS $DISTRO $PYTHON_VERSION $PYTORCH_VERSION $NCCL_VERSION $CUDA_VERSION \
$OUTPUT_IMAGE $NVIDIA_BASE_IMAGE $PYTORCH_EXTRA_INDEX_URL $PYTORCH_GEOMETRIC_URL

docker tag $OUTPUT_IMAGE $CURRENT_IMAGE

cd $pwd
3 changes: 2 additions & 1 deletion devops/scripts/push-fedml-docker.sh
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
#!/bin/bash

export FEDML_VERSION=`cat python/setup.py |grep version= |awk -F'=' '{print $2}' |awk -F',' '{print $1}'|awk -F'"' '{print $2}'`
docker push fedml/fedml:latest-torch1.12.1-cuda11.3-cudnn8-devel
docker push fedml/fedml:latest-torch1.12.1-cuda11.3-cudnn8-devel
docker push fedml/fedml:${FEDML_VERSION}-torch1.12.1-cuda11.3-cudnn8-devel
4 changes: 2 additions & 2 deletions doc/en/starter/installation.md
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ Please refer to the following commands and remember to change `WORKSPACE` to you

**(1) Pull the Docker image and prepare the docker environment**
```
FEDML_DOCKER_IMAGE=fedml/fedml:cuda-11.4.0-devel-ubuntu20.04
FEDML_DOCKER_IMAGE=fedml/fedml:latest-torch1.12.1-cuda11.3-cudnn8-devel
docker pull FEDML_DOCKER_IMAGE
# if you want to use GPUs in your host OS, please follow this link: https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html#docker
Expand All @@ -92,7 +92,7 @@ sudo chmod 777 /var/run/docker.sock
**(2) Run Docker with interactive mode**

```
FEDML_DOCKER_IMAGE=fedml/fedml:cuda-11.4.0-devel-ubuntu20.04
FEDML_DOCKER_IMAGE=fedml/fedml:latest-torch1.12.1-cuda11.3-cudnn8-devel
WORKSPACE=/home/chaoyanghe/sourcecode/FedML_startup/FedML
docker run -t -i -v $WORKSPACE:$WORKSPACE --shm-size=64g --ulimit nofile=65535 --ulimit memlock=-1 --privileged \
Expand Down

0 comments on commit 37c544b

Please sign in to comment.