Skip to content

Add operator,hooks for google cloud log sink #51929

@arvindp25

Description

@arvindp25

Description

Cloud Logging Sink is a Google Cloud feature that allows exporting gcp logs to various destinations such as Cloud Storage, BigQuery, or Pub/Sub for analytics, auditing, and archival purposes.
For more details, see:
https://cloud.google.com/logging/docs/export

This new feature adds support in Airflow for managing log sinks, enabling users to:
1.Create, Get, Update, and Delete log sinks targeting various destinations.
2. Support optional parameter

Use case/motivation

In the data engineering paradigm, it is often necessary to export logs for analytical purposes or to store them for auditing. With this new feature, users can create log sinks directly within Airflow and seamlessly integrate them into data pipelines.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions