Task is taking more than 5 minutes to fail #50654
Description
Apache Airflow version
main (development)
If "Other Airflow 2 version" selected, which one?
No response
What happened?
When there are 2 assets with same name and there is task which has these 2 assets as outlet then task is taking more than 5 minutes to fail.
What you think should happen instead?
No response
How to reproduce
Run below dag on main latest and notice 'task1' is taking more than 5 minutes to fail
from airflow.providers.standard.operators.empty import EmptyOperator
from airflow.providers.standard.operators.python import PythonOperator
from airflow.sdk import Asset
from airflow.sdk import DAG
from airflow.utils.trigger_rule import TriggerRule
from pendulum import today
from dags.plugins.airflow_dag_introspection import assert_the_task_states
left = Asset(name='asset_name')
right = Asset(name='asset_name', uri="asset_uri")
with DAG(
dag_id="asset_with_duplicate_name",
start_date=today('UTC').add(days=-2),
schedule=None,
max_active_runs=1,
tags=["asset", "AIP-74"],
) as dag:
task1 = EmptyOperator(task_id='task1', outlets=[left, right])
status = PythonOperator(
task_id="assert_task_status",
python_callable=assert_the_task_states,
op_args=[{"task1": "failed"}],
trigger_rule=TriggerRule.ALL_DONE,
)
task1 >> statusOperating System
Linux
Versions of Apache Airflow Providers
No response
Deployment
Other
Deployment details
No response
Anything else?
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct