Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AIP-61 - Support task adoption for hybrid executors #39531

Merged
merged 1 commit into from
May 13, 2024

Conversation

o-nikolas
Copy link
Contributor

Sort the set of tasks that are up for adoption by the executor they're configured to run on (if any) and send them to the appropriate executor for adoption.


^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

Sort the set of tasks that are up for adoption by the executor they're
configured to run on (if any) and send them to the appropriate executor
for adoption.
@boring-cyborg boring-cyborg bot added area:Executors-core LocalExecutor & SequentialExecutor area:Scheduler including HA (high availability) scheduler labels May 9, 2024
@o-nikolas o-nikolas requested a review from ferruzzi May 9, 2024 19:03
@o-nikolas o-nikolas merged commit 3e229d8 into apache:main May 13, 2024
41 checks passed
@o-nikolas o-nikolas deleted the onikolas/aip-61/task_adoption branch May 13, 2024 18:10
potiuk added a commit to potiuk/airflow that referenced this pull request May 14, 2024
The tests introduced in apache#39531 introduced side effect of cleaning
the dictionary of executors - they started to fail main in tests
where bothn DB and NonDB tests were run together.
potiuk added a commit that referenced this pull request May 14, 2024
The tests introduced in #39531 introduced side effect of cleaning
the dictionary of executors - they started to fail main in tests
where bothn DB and NonDB tests were run together.
@utkarsharma2 utkarsharma2 added the type:new-feature Changelog: New Features label Jun 3, 2024
@utkarsharma2 utkarsharma2 added this to the Airflow 2.10.0 milestone Jun 3, 2024
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
Sort the set of tasks that are up for adoption by the executor they're
configured to run on (if any) and send them to the appropriate executor
for adoption.
romsharon98 pushed a commit to romsharon98/airflow that referenced this pull request Jul 26, 2024
The tests introduced in apache#39531 introduced side effect of cleaning
the dictionary of executors - they started to fail main in tests
where bothn DB and NonDB tests were run together.
@jedcunningham jedcunningham added area:hybrid-executors AIP-61 and removed type:new-feature Changelog: New Features labels Aug 9, 2024
@jedcunningham jedcunningham added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Aug 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Executors-core LocalExecutor & SequentialExecutor area:hybrid-executors AIP-61 area:Scheduler including HA (high availability) scheduler changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants