Skip to content

Conversation

@MaicoTimmerman
Copy link
Contributor

Whenever the statsd_exporter's mapping is changed, the deployment will need to restart. This loses some metrics. The statsd_exporter exposes a lifecycle API: https://github.com/prometheus/statsd_exporter?tab=readme-ov-file#lifecycle-api in order to reload the mapping.

This is great, because we can reload mappings without losing metrics and downtime. However, quoting the Kubernetes documentation:

A container using a ConfigMap as a subPath volume mount will not receive updates when the ConfigMap changes.

In this MR we resolve it, by mounting all files from the Statsd ConfigMap in the /etc/statsd-exporter. This results in the same end result in the container filesystem, as it only contains a single file (mappings.yml).


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added the area:helm-chart Airflow Helm Chart label Aug 27, 2025
@MaicoTimmerman MaicoTimmerman force-pushed the statsd-volume-mount-without-subpath branch 4 times, most recently from a19e410 to 83085fd Compare August 28, 2025 09:57
@MaicoTimmerman MaicoTimmerman marked this pull request as ready for review August 28, 2025 11:32
@MaicoTimmerman MaicoTimmerman force-pushed the statsd-volume-mount-without-subpath branch from 83085fd to 93da6ed Compare September 1, 2025 18:59
@MaicoTimmerman MaicoTimmerman force-pushed the statsd-volume-mount-without-subpath branch from 93da6ed to b5de250 Compare September 15, 2025 18:58
@MaicoTimmerman MaicoTimmerman force-pushed the statsd-volume-mount-without-subpath branch from b5de250 to a9163d6 Compare September 16, 2025 08:31
@romsharon98 romsharon98 merged commit 3287117 into apache:main Sep 16, 2025
76 checks passed
suman-himanshu pushed a commit to suman-himanshu/airflow that referenced this pull request Sep 17, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Sep 30, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 1, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 2, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 3, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 4, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 5, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 5, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 7, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 8, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 9, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 10, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 11, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 12, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 14, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 15, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 17, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
abdulrahman305 bot pushed a commit to abdulrahman305/airflow that referenced this pull request Oct 19, 2025
…ng (apache#54986)

Co-authored-by: maico.timmerman@gmail.com <maico.timmerman@adyen.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:helm-chart Airflow Helm Chart

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants