Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix][ci] Configure Docker data-root to /mnt/docker to avoid running out of disk space #23909

Merged

Conversation

lhotari
Copy link
Member

@lhotari lhotari commented Jan 29, 2025

Motivation

In GitHub Actions CI, disk space has been running out recently.

Error:  Failed to execute goal io.fabric8:docker-maven-plugin:0.45.1:build (default) on project pulsar-all-docker-image: Unable to build image [apachepulsar/pulsar-all] : "write /pulsar/connectors/pulsar-io-solr-4.1.0-SNAPSHOT.nar: no space left on device" -> [Help 1]

(example from https://github.com/apache/pulsar/actions/runs/13032747233/job/36356115521?pr=23901#step:10:25266)

Modifications

When running clean-disk action with mode: full, configure Docker data-root to /mnt/docker to avoid running out of disk space. The /mnt disk has over 66GB free space in GitHub Actions CI.

Documentation

  • doc
  • doc-required
  • doc-not-needed
  • doc-complete

@github-actions github-actions bot added the doc-not-needed Your PR changes do not impact docs label Jan 29, 2025
@entvex
Copy link
Contributor

entvex commented Jan 29, 2025

LGTM 👍

@lhotari lhotari changed the title [fix][ci] In GitHub Actions CI configure Docker data-root to /mnt/docker to avoid running out of disk space [fix][ci] Configure Docker data-root to /mnt/docker to avoid running out of disk space Jan 29, 2025
@codecov-commenter
Copy link

codecov-commenter commented Jan 29, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 74.11%. Comparing base (bbc6224) to head (8bfdf0f).
Report is 875 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@             Coverage Diff              @@
##             master   #23909      +/-   ##
============================================
+ Coverage     73.57%   74.11%   +0.54%     
+ Complexity    32624    31758     -866     
============================================
  Files          1877     1853      -24     
  Lines        139502   143650    +4148     
  Branches      15299    16320    +1021     
============================================
+ Hits         102638   106472    +3834     
+ Misses        28908    28781     -127     
- Partials       7956     8397     +441     
Flag Coverage Δ
inttests 26.81% <ø> (+2.23%) ⬆️
systests 23.13% <ø> (-1.19%) ⬇️
unittests 73.64% <ø> (+0.80%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 1032 files with indirect coverage changes

@lhotari lhotari merged commit ed5dbb5 into apache:master Jan 29, 2025
55 of 57 checks passed
lhotari added a commit that referenced this pull request Jan 29, 2025
lhotari added a commit that referenced this pull request Jan 29, 2025
lhotari added a commit that referenced this pull request Jan 29, 2025
nikhil-ctds pushed a commit to datastax/pulsar that referenced this pull request Jan 31, 2025
…out of disk space (apache#23909)

(cherry picked from commit ed5dbb5)
(cherry picked from commit 9804170)
nikhil-ctds added a commit to nikhil-ctds/ds-pulsar that referenced this pull request Feb 3, 2025
nikhil-ctds added a commit to nikhil-ctds/ds-pulsar that referenced this pull request Feb 3, 2025
nikhil-ctds added a commit to datastax/pulsar that referenced this pull request Feb 3, 2025
nikhil-ctds added a commit to datastax/pulsar that referenced this pull request Feb 3, 2025
srinath-ctds pushed a commit to datastax/pulsar that referenced this pull request Feb 3, 2025
…out of disk space (apache#23909)

(cherry picked from commit ed5dbb5)
(cherry picked from commit 9804170)
srinath-ctds pushed a commit to datastax/pulsar that referenced this pull request Feb 3, 2025
nodece pushed a commit to ascentstream/pulsar that referenced this pull request Feb 10, 2025
lhotari added a commit that referenced this pull request Feb 10, 2025
… it exists

- In branch-3.0, -Ddocker.squash=true is used and it relies on experimental key set to true
  in daemon.json. The docker image build fails with "connection reset by peer" if squash is requested
  and the daemon doesn't support it.
  - The daemon.json file was overridden with #23909 changes and the experimental setting got removed.
nodece pushed a commit to ascentstream/pulsar that referenced this pull request Feb 11, 2025
… it exists

- In branch-3.0, -Ddocker.squash=true is used and it relies on experimental key set to true
  in daemon.json. The docker image build fails with "connection reset by peer" if squash is requested
  and the daemon doesn't support it.
  - The daemon.json file was overridden with apache#23909 changes and the experimental setting got removed.
hanmz pushed a commit to hanmz/pulsar that referenced this pull request Feb 12, 2025
mukesh-ctds pushed a commit to datastax/pulsar that referenced this pull request Feb 18, 2025
…running out of disk space (apache#23909)"

This reverts commit f58ea21.

(cherry picked from commit fecfdff)
nikhil-ctds pushed a commit to datastax/pulsar that referenced this pull request Feb 19, 2025
… it exists

- In branch-3.0, -Ddocker.squash=true is used and it relies on experimental key set to true
  in daemon.json. The docker image build fails with "connection reset by peer" if squash is requested
  and the daemon doesn't support it.
  - The daemon.json file was overridden with apache#23909 changes and the experimental setting got removed.

(cherry picked from commit fab143b)
srinath-ctds pushed a commit to datastax/pulsar that referenced this pull request Feb 24, 2025
… it exists

- In branch-3.0, -Ddocker.squash=true is used and it relies on experimental key set to true
  in daemon.json. The docker image build fails with "connection reset by peer" if squash is requested
  and the daemon doesn't support it.
  - The daemon.json file was overridden with apache#23909 changes and the experimental setting got removed.

(cherry picked from commit fab143b)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants