Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AIP84: Check standalone_dag_processor config in get_airflow_health() and update health endpoint #44383

Merged

Conversation

vatsrahul1001
Copy link
Collaborator

@vatsrahul1001 vatsrahul1001 commented Nov 26, 2024

closes: #44253

Motivation

Right now the UI has to check the scheduler config for standalone_dag_processor in order to determine if the dag_processor health check should be rendered.

This PR does that check-in get_airflow_health() and also handles this inthe public/health endpoint.

Testing

Response with DAG Processor enabled

image

Response with DAG Processor disabled

image

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@boring-cyborg boring-cyborg bot added area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers. labels Nov 26, 2024
@vatsrahul1001 vatsrahul1001 marked this pull request as draft November 26, 2024 11:03
@vatsrahul1001 vatsrahul1001 force-pushed the AIP84-health-endpoint-skip-dag-processor branch from 68b8f22 to 54ac2c3 Compare November 26, 2024 14:16
@vatsrahul1001 vatsrahul1001 force-pushed the AIP84-health-endpoint-skip-dag-processor branch from 54ac2c3 to 4932f69 Compare November 26, 2024 15:08
…:astronomer/airflow into AIP84-health-endpoint-skip-dag-processor
@vatsrahul1001 vatsrahul1001 marked this pull request as ready for review November 26, 2024 15:50
@vatsrahul1001 vatsrahul1001 changed the title AIP84: Update health endpoint to handle when there is no dag_processor object in response AIP84: Check standalone_dag_processor config in get_airflow_health() and update health endpoint Nov 26, 2024
@vatsrahul1001 vatsrahul1001 requested a review from rawwar November 27, 2024 07:01
Copy link
Member

@pierrejeambrun pierrejeambrun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice

tests/api/common/test_airflow_health.py Outdated Show resolved Hide resolved
tests/api_fastapi/core_api/routes/public/test_monitor.py Outdated Show resolved Hide resolved
airflow/ui/src/pages/Dashboard/Health/Health.tsx Outdated Show resolved Hide resolved
airflow/ui/src/pages/Dashboard/Health/Health.tsx Outdated Show resolved Hide resolved
airflow/api_fastapi/core_api/routes/public/monitor.py Outdated Show resolved Hide resolved
airflow/api_fastapi/core_api/datamodels/monitor.py Outdated Show resolved Hide resolved
@rawwar rawwar mentioned this pull request Nov 29, 2024
1 task
Copy link
Member

@pierrejeambrun pierrejeambrun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

@pierrejeambrun pierrejeambrun merged commit c4d44e7 into apache:main Nov 29, 2024
66 checks passed
@pierrejeambrun pierrejeambrun deleted the AIP84-health-endpoint-skip-dag-processor branch November 29, 2024 15:20
LefterisXefteris pushed a commit to LefterisXefteris/airflow that referenced this pull request Jan 5, 2025
…and update health endpoint (apache#44383)

* AIP84 health endpoint skip dag processor

* AIP84 health endpoint skip dag processor

* fixing test_airflow_health tests and adding new tests

* AIP84 health endpoint skip dag processor

* AIP84 health endpoint skip dag processor

* fixing test_airflow_health tests and adding new tests

* fix static tests

* Using only one model class HealthInfoSchema

* fixing static checks

* implement review comments

* fix static tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:API Airflow's REST/HTTP API area:UI Related to UI/UX. For Frontend Developers.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Check standalone_dag_processor config in get_airflow_health()
3 participants