Skip to content

Conversation

@jason810496
Copy link
Member

Why

While fixing CI on the v2-10-test branch, I noticed that some Kubernetes tests are flaky.
For example: https://github.com/apache/airflow/actions/runs/14176933252/job/39716299877

We should port #46502 (Fix flaky Kubernetes test: test_integration_run_dag_with_scheduler_failure) to the v2-10-test branch.

@jason810496 jason810496 added area:dev-env CI, pre-commit, pylint and other changes that do not change the behavior of the final code area:dev-tools area:CI Airflow's tests and continious integration full tests needed We need to run full set of tests for this PR to merge labels Apr 11, 2025
@jason810496 jason810496 self-assigned this Apr 11, 2025
@jason810496 jason810496 marked this pull request as draft April 11, 2025 10:43
@potiuk potiuk force-pushed the fix/v2-10-test/k8s-flaky-test-with-test_integration_run_dag_with_scheduler_failure branch from d52e2f5 to 533107c Compare April 12, 2025 16:24
@jason810496 jason810496 force-pushed the fix/v2-10-test/k8s-flaky-test-with-test_integration_run_dag_with_scheduler_failure branch from 533107c to 4679000 Compare April 13, 2025 03:01
@jason810496 jason810496 marked this pull request as ready for review April 13, 2025 03:42
@jason810496
Copy link
Member Author

Finally fix k8s test!

If we use LocalExecutor as executor, the scheduler is deployed in statefulset instead of deployment k8s resource.

After #49163 being merged, v2-10-test branch will be green again I think.
cc @potiuk

@jason810496 jason810496 force-pushed the fix/v2-10-test/k8s-flaky-test-with-test_integration_run_dag_with_scheduler_failure branch from 4679000 to 001308a Compare April 20, 2025 09:44
@jason810496 jason810496 marked this pull request as draft April 20, 2025 10:25
@jason810496 jason810496 force-pushed the fix/v2-10-test/k8s-flaky-test-with-test_integration_run_dag_with_scheduler_failure branch from 001308a to ff7dc38 Compare April 20, 2025 10:28
@jason810496 jason810496 marked this pull request as ready for review April 20, 2025 11:27
@jason810496 jason810496 merged commit 8c68d69 into apache:v2-10-test Apr 22, 2025
109 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:CI Airflow's tests and continious integration area:dev-env CI, pre-commit, pylint and other changes that do not change the behavior of the final code area:dev-tools full tests needed We need to run full set of tests for this PR to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants