Process unavailable: centos7/x64 docker build image generation

[sxa]

The CentOS7/x64 axis of https://ci.adoptopenjdk.net/job/centos7_docker_image_updater/ has been failing quite often recently. It seems to be a problem during the final push to dockerhub. For example https://ci.adoptopenjdk.net/job/centos7_docker_image_updater/230/execution/node/153/log shows:

+ docker push index.docker.io/adoptopenjdk/centos7_build_image:linux-amd64
The push refers to repository [docker.io/adoptopenjdk/centos7_build_image]
e0683245da81: Preparing
ad4a2e554215: Preparing
fe1d972678a7: Preparing
bb1d0989bbe4: Preparing
e3d706078081: Preparing
7638bc9ca1b7: Preparing
2cae1421dbe8: Preparing
35b50ab468e9: Preparing
174f56854903: Preparing
174f56854903: Waiting
2cae1421dbe8: Waiting
7638bc9ca1b7: Waiting
e3d706078081: Pushed
e0683245da81: Pushed
ad4a2e554215: Pushed
fe1d972678a7: Pushed
174f56854903: Layer already exists
7638bc9ca1b7: Pushed
2cae1421dbe8: Pushed
35b50ab468e9: Pushed
unauthorized: authentication required

Other platforms appear unaffected.

[gdams]

So the docker push step fails on docker-packet-ubuntu2004-intel-1 but passes docker-packet-ubuntu2004-amd-1

The docker version on the intel machine is 20.10.7 compared to 20.10.12 on the AMD one.

I'm going to start by updating the docker version on the intel machine to see if that fixes things

[gdams]

docker-packet-ubuntu2004-intel-1 has now been updated to 20.10.17. Hopefully the problem won't persist

[sxa]

Looks like it may still be a problem, but I've run the job after bringing the problematic node offline and it has pushed the new images successfully at https://ci.adoptopenjdk.net/job/centos7_docker_image_updater/235 so at least we have a workaround that will allow builds to get out

[sxa]

@gdams This still seems to be happening fairly regularly - what was the latest on the analysis of this?

[sxa]

While this has generally been working reliably https://ci.adoptium.net/job/centos7_docker_image_updater/571/consoleFull looks to have failed on a dynamic azure agent.