Skip to content

ci(docker-build-and-push.yaml): add max-parallelism option to restrict docker build make parallelism #6081

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 18 commits into
base: main
Choose a base branch
from

Conversation

youtalk
Copy link
Member

@youtalk youtalk commented Apr 24, 2025

Description

Communication disruptions like the following with GitHub runners frequently occur.

docker-build-and-push-cuda (amd64)
The self-hosted runner lost communication with the server. Verify the machine is running and has a healthy network connection. Anything in your workflow that terminates the runner process, starves it for CPU/Memory, or blocks its network access can cause this error.

So this PR limits the maximum number of parallel executions for docker build bake to 2, which is half the number of CPU cores. This will slightly increase execution time, but is expected to alleviate CPU and memory exhaustion.
https://docs.docker.com/build/ci/github-actions/configure-builder/#max-parallelism

How was this PR tested?

https://github.com/autowarefoundation/autoware/actions/runs/14675233667

Notes for reviewers

None.

Effects on system behavior

None.

youtalk added 7 commits April 23, 2025 10:07
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Copy link

github-actions bot commented Apr 24, 2025

Thank you for contributing to the Autoware project!

🚧 If your pull request is in progress, switch it to draft mode.

Please ensure:

@youtalk youtalk changed the title Ci set swap space cuda ci(docker-build-and-push.yaml): run set-swap-space on cuda job Apr 24, 2025
youtalk added 5 commits April 24, 2025 15:23
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
@youtalk youtalk added the run:health-check Run health-check label Apr 24, 2025
@youtalk youtalk changed the title ci(docker-build-and-push.yaml): run set-swap-space on cuda job ci(docker-build-and-push.yaml): add max-parallelism option to restrict docker build make parallelism Apr 24, 2025
youtalk added 5 commits April 24, 2025 16:31
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
Signed-off-by: Yutaka Kondo <yutaka.kondo@youtalk.jp>
@youtalk youtalk self-assigned this Apr 24, 2025
@youtalk youtalk added type:github-actions Github actions related. (auto-assigned) type:ci Continuous Integration (CI) processes and testing. labels Apr 24, 2025
@youtalk youtalk marked this pull request as ready for review April 24, 2025 13:47
@youtalk youtalk requested a review from oguzkaganozt as a code owner April 24, 2025 13:47
@youtalk youtalk requested review from xmfcx and mitsudome-r April 24, 2025 13:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
run:health-check Run health-check type:ci Continuous Integration (CI) processes and testing. type:github-actions Github actions related. (auto-assigned)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant