Skip to content

ci(docker-build-and-push.yaml): add max-parallelism option to restrict docker build make parallelism #6081

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 18 commits into
base: main
Choose a base branch
from
Open

ci(docker-build-and-push.yaml): add max-parallelism option to restrict docker build make parallelism #6081

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
c3f1feb
add utility-image arg
youtalk Apr 23, 2025
fb9a69e
set commit hash
youtalk Apr 23, 2025
1acc68e
split update-docker-manifest
youtalk Apr 24, 2025
034250c
set-swap-space on cuda job
youtalk Apr 24, 2025
1316f9c
add comment
youtalk Apr 24, 2025
90759ab
Merge branch 'ci/utility-image' into ci/set-swap-space-cuda
youtalk Apr 24, 2025
712c3df
Merge branch 'ci/update-docker-manifest' into ci/set-swap-space-cuda
youtalk Apr 24, 2025
4c321ae
set-swap-space on all jobs
youtalk Apr 24, 2025
bc97b00
set max-parallelism
youtalk Apr 24, 2025
ad238e3
Revert "set-swap-space on all jobs"
youtalk Apr 24, 2025
4e73921
Revert "set-swap-space on cuda job"
youtalk Apr 24, 2025
20acd78
remove swap
youtalk Apr 24, 2025
0e4243e
wip
youtalk Apr 24, 2025
5c54863
fix precommit
youtalk Apr 24, 2025
169c7a6
revert
youtalk Apr 24, 2025
e955a7a
fix indent
youtalk Apr 24, 2025
de8b679
decrease swap size
youtalk Apr 24, 2025
a3405ac
Merge branch 'main' into ci-set-swap-space-cuda
youtalk Apr 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions .github/actions/docker-build-and-push-base/action.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,21 @@ inputs:
build-args:
description: Additional build args.
required: false
max-parallelism:
default: 2
description: Maximum parallelism for buildkitd.
required: false

runs:
using: composite
steps:
- name: Setup Docker Buildx
uses: docker/setup-buildx-action@v3
with:
buildkitd-config-inline: |
[worker.oci]
max-parallelism = ${{ inputs.max-parallelism }}
install: true

- name: Get current date
id: date
Expand Down
9 changes: 9 additions & 0 deletions .github/actions/docker-build-and-push-cuda/action.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,10 @@ inputs:
build-args:
description: Additional build args.
required: false
max-parallelism:
default: 2
description: Maximum parallelism for buildkitd.
required: false

runs:
using: composite
Expand All @@ -31,6 +35,11 @@ runs:

- name: Setup Docker Buildx
uses: docker/setup-buildx-action@v3
with:
buildkitd-config-inline: |
[worker.oci]
max-parallelism = ${{ inputs.max-parallelism }}
install: true

- name: Restore ccache
uses: actions/cache/restore@v4
Expand Down
9 changes: 9 additions & 0 deletions .github/actions/docker-build-and-push-tools/action.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,10 @@ inputs:
build-args:
description: Additional build args.
required: false
max-parallelism:
default: 2
description: Maximum parallelism for buildkitd.
required: false

runs:
using: composite
Expand All @@ -30,6 +34,11 @@ runs:

- name: Setup Docker Buildx
uses: docker/setup-buildx-action@v3
with:
buildkitd-config-inline: |
[worker.oci]
max-parallelism = ${{ inputs.max-parallelism }}
install: true

- name: Cache ccache
uses: actions/cache@v4
Expand Down
9 changes: 9 additions & 0 deletions .github/actions/docker-build-and-push/action.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,10 @@ inputs:
build-args:
description: Additional build args.
required: false
max-parallelism:
default: 2
description: Maximum parallelism for buildkitd.
required: false

runs:
using: composite
Expand All @@ -31,6 +35,11 @@ runs:

- name: Setup Docker Buildx
uses: docker/setup-buildx-action@v3
with:
buildkitd-config-inline: |
[worker.oci]
max-parallelism = ${{ inputs.max-parallelism }}
install: true

- name: Restore ccache
uses: actions/cache/restore@v4
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/docker-build-and-push.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ jobs:
matrix.platform == 'arm64' }}
uses: pierotofy/set-swap-space@0404882bc4666c0ff2f6fd8b3d32af69a730183c
with:
swap-size-gb: 16
swap-size-gb: 8

- name: Build 'Autoware' without CUDA
if: ${{ steps.changed-files.outputs.any_changed == 'true' ||
Expand Down Expand Up @@ -144,7 +144,7 @@ jobs:
matrix.platform == 'arm64' }}
uses: pierotofy/set-swap-space@0404882bc4666c0ff2f6fd8b3d32af69a730183c
with:
swap-size-gb: 16
swap-size-gb: 8

- name: Build 'autoware-tools'
if: ${{ steps.changed-files.outputs.any_changed == 'true' ||
Expand Down Expand Up @@ -218,7 +218,7 @@ jobs:
matrix.platform == 'arm64' }}
uses: pierotofy/set-swap-space@0404882bc4666c0ff2f6fd8b3d32af69a730183c
with:
swap-size-gb: 16
swap-size-gb: 8

- name: Build 'Autoware' with CUDA
if: ${{ steps.changed-files.outputs.any_changed == 'true' ||
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/health-check.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,7 +83,7 @@ jobs:
matrix.platform == 'arm64' }}
uses: pierotofy/set-swap-space@0404882bc4666c0ff2f6fd8b3d32af69a730183c
with:
swap-size-gb: 16
swap-size-gb: 8

- name: Build 'Autoware'
if: ${{ steps.changed-files.outputs.any_changed == 'true' ||
Expand Down
Loading