Explore and add static checks for DAGs for early detection of common issues

[omkar-foss]

Description

As per users' feedback in the Airflow Debugging Survey 2024, 48.3% of respondents chose early issue detection during execution as one of their top 2 choices.

Use case/motivation

Goal of this issue:

• Enhance early detection of DAG issues to minimize dev time
• Some sort of static analysis similar to Ruff checks for DAGs
• Runtime analysis of DAGs if feasible can also be done to save dev time

Related issues

Parent Issue: #40975

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct