Skip to content

Conversation

@dolfinus
Copy link
Member

@dolfinus dolfinus commented Jan 28, 2026

Change Summary

Implemented handling of Airflow tags. In recent OpenLineage integration versions they are provided in a dedicated tags facet. In older versions they are a part of dag description facet.

Airflow DAG tags is a list of arbitrary strings, not key:value pairs which is expected by DataRentgen or OpenLineage, so we parse only key:value tags. Otherwise it doesn't look usable, e.g. prod:prod instead of env:prod is awful.

Related issue number

Checklist

  • Commit message and PR title is comprehensive
  • Keep the change as small as possible
  • Unit and integration tests for the changes exist
  • Tests pass on CI and coverage does not decrease
  • Documentation reflects the changes where applicable
  • docs/changelog/next_release/<pull request or issue id>.<change type>.rst file added describing change
    (see CONTRIBUTING.rst for details.)
  • My PR is ready to review.

@dolfinus dolfinus self-assigned this Jan 28, 2026
@dolfinus dolfinus added the ci:skip-changelog Add this label to skip changelog file check label Jan 28, 2026
@github-actions
Copy link

github-actions bot commented Jan 28, 2026

Coverage

Coverage Report •
FileStmtsMissCoverMissing
data_rentgen/consumer/extractors/impl
   airflow_dag.py91297%63, 73
   airflow_task.py116199%95
data_rentgen/openlineage/run_facets
   airflow.py47197%43
TOTAL757092687% 

@dolfinus dolfinus force-pushed the feature/DOP-31832-airflow branch from 5e15edc to fb76b65 Compare January 28, 2026 13:12
@dolfinus dolfinus changed the title Feature/dop 31832 airflow [DOP-31832] Extract Airflow job & run tags Jan 28, 2026
@dolfinus dolfinus marked this pull request as ready for review January 28, 2026 13:15
@dolfinus dolfinus merged commit 85fdbfd into develop Jan 29, 2026
11 checks passed
@dolfinus dolfinus deleted the feature/DOP-31832-airflow branch January 29, 2026 14:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci:skip-changelog Add this label to skip changelog file check

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants