coffea-casa/docker at 2023.02.24 · CoffeaTeam/coffea-casa · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
ceph		ceph
certs		certs
condor		condor
dask		dask
jupyterhub		jupyterhub
k8s-worker		k8s-worker
prepare-env		prepare-env
skyhook		skyhook
uproot		uproot
Dockerfile.cc-analysis-centos7		Dockerfile.cc-analysis-centos7
Dockerfile.cc-analysis-centos7-skyhook		Dockerfile.cc-analysis-centos7-skyhook
Dockerfile.cc-analysis-ubuntu		Dockerfile.cc-analysis-ubuntu
Dockerfile.cc-analysis-ubuntu-skyhook		Dockerfile.cc-analysis-ubuntu-skyhook
Dockerfile.cc-base-centos7		Dockerfile.cc-base-centos7
Dockerfile.cc-base-ubuntu		Dockerfile.cc-base-ubuntu
Dockerfile.cc-centos7		Dockerfile.cc-centos7
Dockerfile.cc-centos7-skyhook		Dockerfile.cc-centos7-skyhook
Dockerfile.cc-ubuntu		Dockerfile.cc-ubuntu
Dockerfile.cc-ubuntu-skyhook		Dockerfile.cc-ubuntu-skyhook
README.md		README.md

README.md

Coffea-casa Docker images: UNL-specific and custom

Coffea-casa Dask Base Scheduler image (without UNL specific settings)

To build and test locally:

docker build -t hub.opensciencegrid.org/coffea-casa/cc-base-ubuntu:latest  -f Dockerfile.cc-base-ubuntu

Coffea-casa Dask Scheduler (with UNL specific settings)

To build and test locally (with UNL specific settings, and only after was built Dask Base Scheduler image):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-ubuntu:latest  -f Dockerfile.cc-base-ubuntu

Coffea-casa Dask Base Scheduler CC7 image (without UNL specific settings)

To build and test locally (with UNL specific settings):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-base-centos7:latest  -f Dockerfile.cc-base-centos7

Coffea-casa Dask Scheduler (with UNL specific settings)

To build and test locally (with UNL specific settings and only after was built Dask Base Scheduler CC7 image):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-centos7:latest -f Dockerfile.cc-centos7

Coffea-casa Dask Worker CC7

To build and test locally (with UNL specific settings):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-analysis-centos7-skyhook:latest -f Dockerfile.cc-analysis-centos7-skyhook

Coffea-casa Dask Worker Ubuntu

To build and test locally (with UNL specific settings):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-analysis-ubuntu-skyhook:latest -f Dockerfile.cc-analysis-ubuntu-skyhook

Coffea-casa Dask Worker CC7 (with Skyhook)

To build and test locally (with UNL specific settings and only after was built Dask Worker CC7 image):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-analysis-centos7-skyhook:latest -f Dockerfile.cc-analysis-centos7-skyhook

Coffea-casa Dask Worker Ubuntu (with Skyhook)

To build and test locally (with UNL specific settings and only after was built Dask Worker CC7 image):

docker build -t hub.opensciencegrid.org/coffea-casa/cc-analysis-ubuntu-skyhook:latest -f Dockerfile.cc-analysis-ubuntu-skyhook

How to build images for different cluster

See below full table of arguments for Scheduler and Worker image:

Parameter	Description	Default
`TAG`	Name of tag in REGISTRY (only for "derived" images)	"development"
`PROJECT`	Name of project in REGISTRY (only for "derived" images)	"coffea-casa"
`REGISTRY`	Name of Hub (only for "derived" images)	"hub.opensciencegrid.org"
`NAME`	Name of Base image (only for "derived" images)	"${PROJECT}/cc-base-ubuntu"
`NB_USER`	User for Jupyter notebook (as well for HTCondor)	`cms-jovyan`
`NB_UID`	User UID	`6440`
`NB_GID`	User GID	`11265`
`TAG`	Tag used to sync image for worker configured in Coffea_casa Dask Jobqueue extention	`2021.10.28`
`WORKER_IMAGE`	Image name used to sync image for worker configured in Coffea_casa Dask Jobqueue extention	`coffeateam/coffea-casa-analysis`
`XCACHE_HOST`	XCache host used for custom Xrootd plugin	`red-xcache1.unl.edu`
`CACHE_PREFIX`	XCache prefix used for ServiceX	`red-xcache1.unl.edu`
`LABEXTENTION_CLUSTER`	Name of default cluster configured in Coffea_casa Dask Jobqueue extention	`UNL HTCondor Cluster`
`LABEXTENTION_FACTORY_CLASS`	Name of class used for Dask Labextention factory and configured in Coffea_casa Dask Jobqueue extention	`CoffeaCasaCluster`
`LABEXTENTION_FACTORY_MODULE`	Name of python module used for Dask Labextention factory and configured in Coffea_casa Dask Jobqueue extention	`coffea_casa`
`CONDOR_HOST`	HTCondor Condor host	`red-condor.unl.edu`
`COLLECTOR_NAME`	HTCondor collector name	`Nebraska T2`
`UID_DOMAIN`	Domain	`t3.unl.edu`
`SCHEDD_HOST`	HTCondor schedduler host	`t3.unl.edu`
`CERT_DIR`	Directory where are generated all secrets (see charts)	`/etc/cmsaf-secrets`
`BEARER_TOKEN_FILE`	Bearer token file location (see charts)	`/opt/dask`
`DASK_ROOT_CONFIG`	Dask configuration file directory	`/opt/dask`

Custom Coffea-casa Base Scheduler image

Important note: please check that TAG values are the same for scheduler and worker image (as well Docker image tags!)

docker build 
--build-arg NB_USER="atlas-jovyan" \
--build-arg NB_UID="6440" \
--build-arg NB_GID="11265" \
--build-arg LABEXTENTION_CLUSTER="UNL HTCondor Cluster" \
--build-arg LABEXTENTION_FACTORY_CLASS="CoffeaCasaCluster" \
--build-arg LABEXTENTION_FACTORY_MODULE="coffea_casa" \
--build-arg CONDOR_HOST="red-condor.unl.edu" \
--build-arg COLLECTOR_NAME="Nebraska T2" \
--build-arg UID_DOMAIN="unl.edu" \
--build-arg SCHEDD_HOST="t3.unl.edu" \
 -t hub.opensciencegrid.org/coffea-casa/cc-base-ubuntu:$TAG -f Dockerfile.cc-base-ubuntu

Custom Coffea-casa Dask Scheduler image

Important note: please check that TAG values are the same for scheduler and worker image (as well Docker image tags!)

docker build
--build-arg PROJECT="coffea-casa" \
--build-arg TAG="2021.10.28" \
--build-arg REGISTRY="hub.opensciencegrid.org" \
--build-arg XCACHE_HOST="red-xcache1.unl.edu" \
--build-arg CACHE_PREFIX="red-xcache1.unl.edu" \
--build-arg LABEXTENTION_CLUSTER="UNL HTCondor Cluster" \
--build-arg LABEXTENTION_FACTORY_CLASS="CoffeaCasaCluster" \
--build-arg LABEXTENTION_FACTORY_MODULE="coffea_casa" \
--build-arg CONDOR_HOST="red-condor.unl.edu" \
--build-arg COLLECTOR_NAME="Nebraska T2" \
--build-arg UID_DOMAIN="unl.edu" \
--build-arg SCHEDD_HOST="t3.unl.edu" \
-t hub.opensciencegrid.org/coffea-casa/cc-ubuntu:$TAG -f Dockerfile.cc-ubuntu

Other build arguments, which are optional to be changed:

--build-arg CERT_DIR="/etc/cmsaf-secrets"
--build-arg BEARER_TOKEN_FILE=$CERT_DIR"/xcache_token"
--build-arg DASK_ROOT_CONFIG="/opt/dask"

Custom Coffea-casa Dask Skyhook Scheduler image

Important note: please check that TAG values are the same for scheduler and worker image (as well Docker image tags!)

docker build
--build-arg PROJECT="coffea-casa" \
--build-arg TAG="2021.10.28" \
--build-arg REGISTRY="hub.opensciencegrid.org" \
-t hub.opensciencegrid.org/coffea-casa/cc-ubuntu:$TAG -f Dockerfile.cc-ubuntu

Custom Coffea-casa Dask Base Worker image

Important note: please check that TAG values are the same for scheduler and worker image (as well Docker image tags!)

docker build 
--build-arg NB_USER="atlas-jovyan" \
--build-arg NB_UID="6440" \
--build-arg NB_GID="11265" \
--build-arg XCACHE_HOST="red-xcache1.unl.edu" \
--build-arg CACHE_PREFIX="red-xcache1.unl.edu" \
-t hub.opensciencegrid.org/coffea-casa/cc-analysis-ubuntu:$TAG -f Dockerfile.cc-analysis-ubuntu

Other build arguments, which are optional to be changed:

--build-arg CERT_DIR="/etc/cmsaf-secrets"
--build-arg BEARER_TOKEN_FILE=$CERT_DIR"/xcache_token"

Custom Coffea-casa Dask Skyhook Worker image

Important note: please check that TAG values are the same for scheduler and worker image (as well Docker image tags!)

docker build 
--build-arg PROJECT="coffea-casa" \
--build-arg TAG="2021.10.28" \
--build-arg REGISTRY="hub.opensciencegrid.org" \
-t hub.opensciencegrid.org/coffea-casa/cc-analysis-ubuntu-skyhook:$TAG -f Dockerfile.cc-analysis-ubuntu-skyhook