Skip to content

Provide OL SQL parser as internal OpenLineage provider API #29673

@mobuchowski

Description

@mobuchowski

Body

To easily provide OpenLineage events from SQL-based operators, we want to add SQL parser API that other providers can use. The API should be stable.

There are two proposed options:

  • Provide literal API - classes that other providers could import and use directly
  • Pass parser class to get_openlineage_facets_* methods that the operators could use, but we need to be careful to not pass it to openlineage-airflow defined methods, as those won't accept it.

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions