Skip to content

automagically tag dags by schedule to make it easier to filter #1295

Open

Description

Current Situation

As I'm working on #1455 , I'm trying to get my head around how often different dags are running concurrently in postgres. This seems like something that should be relatively straightforward to visualize with all of the metadata that Airflow keeps. But after a very superficial look, I couldn't figure out how to do it, and started to wish that there were an easy way to just filter by daily vs monthly etc schedule settings on the main dags page, a la "filter by tags".

Suggested Improvement

Could we just add a tag based on the schedule keyword frequency of each dag?

Benefit

It might help with db load balancing tasks in the future, in addition to risk assessment for the specific thing I'm working on right now. :)

Additional context

It might also be annoying if we start getting into tag overkill / overload, but maybe cross that bridge when we come to it? And/or maybe there is some obvious solution for this already, but a few minutes of googling didn't find it for me.

Implementation

  • 🙋 I would be interested in implementing this feature.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    help wantedOpen to participation from the community🟩 priority: lowLow priority and doesn't need to be rushed🤖 aspect: dxConcerns developers' experience with the codebase🧰 goal: internal improvementImprovement that benefits maintainers, not users🧱 stack: catalogRelated to the catalog and Airflow DAGs

    Type

    No type

    Projects

    • Status

      📋 Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions