Bump io.openlineage:openlineage-java from 1.37.0 to 1.43.0

[dependabot]

Bumps io.openlineage:openlineage-java from 1.37.0 to 1.43.0.

Release notes

Sourced from io.openlineage:openlineage-java's releases.

OpenLineage 1.43.0

Added

• dbt: Extract test severity from dbt tests [#4258](https://github.com/OpenLineage/OpenLineage/issues/4258) @​mobuchowski Add support for extracting and reporting severity information from dbt tests in OpenLineage events.
• Spec: Add severity field to DataQualityAssertionsDatasetFacet [#4257](https://github.com/OpenLineage/OpenLineage/issues/4257) @​mobuchowski Extend the DataQualityAssertionsDatasetFacet with a severity field to indicate the importance level of data quality assertions.
• Spark: Add support for DataSourceRDD with Iceberg [#4263](https://github.com/OpenLineage/OpenLineage/issues/4263) @​kchledowski Enable lineage extraction from DataSourceRDD when reading Iceberg data sources, supporting mixed RDD and DataFrame operations common in AWS Glue environments.

Fixed

• dbt: Fix send-events command argument parsing [#4262](https://github.com/OpenLineage/OpenLineage/issues/4262) @​mobuchowski Fix IndexError when running 'dbt-ol send-events' command without additional arguments by properly checking args length.
• Spark: Fix BigQuery column-level lineage namespace [#4264](https://github.com/OpenLineage/OpenLineage/issues/4264) @​mobuchowski Fix incorrect "namespace" value in BigQuery column-level lineage to match the format used by regular BigQuery dataset collection.
• Spark: Fix isDeltaPlan() to handle multiple Spark extensions [#4268](https://github.com/OpenLineage/OpenLineage/issues/4268) @​mobuchowski Fix Delta detection failing when multiple Spark extensions are configured (comma-separated), enabling proper event filtering in environments like Azure Fabric or when using Gluten.
• Spark: Fix META-INF/services files of relocated packages [#4243](https://github.com/OpenLineage/OpenLineage/issues/4243) @​kchledowski Fix service provider interface conflicts caused by package relocation not updating META-INF/services configuration files.

OpenLineage 1.42.1

Added

• DataZone transport: Add cross-region support [#4218](https://github.com/OpenLineage/OpenLineage/issues/4218) @​RohithKayathi Enable posting lineage events to DataZone domains in different regions from where data transformation jobs run.
• Spark: Add config for disabling RDD event emitting [#4118](https://github.com/OpenLineage/OpenLineage/issues/4118) @​kchledowski Add new configuration option spark.openlineage.filter.rddEventsDisabled to selectively disable OpenLineage event emission for RDD operations while keeping SQL-based operations enabled.
• Spark: Add schema and CLL facets for Snowflake writes [#4124](https://github.com/OpenLineage/OpenLineage/issues/4124) @​kchledowski Add schema and column-level lineage support for Snowflake datasets when using the Spark-Snowflake connector.
• Spark: Add spark.openlineage.applicationRunId override [#4215](https://github.com/OpenLineage/OpenLineage/issues/4215) @​wslulciuc Add support to override the application runID via the property spark.openlineage.applicationRunId.
• Spec: Add ExecutionParametersRunFacet [#4182](https://github.com/OpenLineage/OpenLineage/issues/4182) @​jakub-moravec Add a new facet to capture input parameters supplied to a job at the time of execution, enabling reproducibility, debugging, and richer lineage context.

Changed

• Java: Update GCP Lineage transport version and fix dependency shading [#3768](https://github.com/OpenLineage/OpenLineage/issues/3768) @​tnazarew Update GCP Lineage transport to use new version of the producer library with fixed dependency shading.
• Python: Show what transport failed to create [#4220](https://github.com/OpenLineage/OpenLineage/issues/4220) @​mobuchowski Improve error messages to indicate which transport failed to create.
• Spark: Prevent classloader issue by gating log behind additional flag [#4207](https://github.com/OpenLineage/OpenLineage/issues/4207) @​mobuchowski Fix classloader conflicts with BigQuery connector by gating DEBUG toJSON() logging behind an additional flag and logging exceptions.

Fixed

• Python: Fix .with_additional_properties() annotation [#4197](https://github.com/OpenLineage/OpenLineage/issues/4197) @​dolfinus Fix type annotation for .with_additional_properties() method to correctly accept keyword arguments.
• Spark: Fix BigQuery symlinks with ".db" suffix [#4192](https://github.com/OpenLineage/OpenLineage/issues/4192) @​kchledowski Fix BigQuery symlink namespace incorrectly having ".db" suffix in RUNNING and COMPLETE events by avoiding mutation of the Identifier object.

... (truncated)

Changelog

Sourced from io.openlineage:openlineage-java's changelog.

1.43.0

Added

• dbt: Extract test severity from dbt tests [#4258](https://github.com/OpenLineage/OpenLineage/issues/4258) @​mobuchowski Add support for extracting and reporting severity information from dbt tests in OpenLineage events.
• Spec: Add severity field to DataQualityAssertionsDatasetFacet [#4257](https://github.com/OpenLineage/OpenLineage/issues/4257) @​mobuchowski Extend the DataQualityAssertionsDatasetFacet with a severity field to indicate the importance level of data quality assertions.
• Spark: Add support for DataSourceRDD with Iceberg [#4263](https://github.com/OpenLineage/OpenLineage/issues/4263) @​kchledowski Enable lineage extraction from DataSourceRDD when reading Iceberg data sources, supporting mixed RDD and DataFrame operations common in AWS Glue environments.

Fixed

• dbt: Fix send-events command argument parsing [#4262](https://github.com/OpenLineage/OpenLineage/issues/4262) @​mobuchowski Fix IndexError when running 'dbt-ol send-events' command without additional arguments by properly checking args length.
• Spark: Fix BigQuery column-level lineage namespace [#4264](https://github.com/OpenLineage/OpenLineage/issues/4264) @​mobuchowski Fix incorrect "namespace" value in BigQuery column-level lineage to match the format used by regular BigQuery dataset collection.
• Spark: Fix isDeltaPlan() to handle multiple Spark extensions [#4268](https://github.com/OpenLineage/OpenLineage/issues/4268) @​mobuchowski Fix Delta detection failing when multiple Spark extensions are configured (comma-separated), enabling proper event filtering in environments like Azure Fabric or when using Gluten.
• Spark: Fix META-INF/services files of relocated packages [#4243](https://github.com/OpenLineage/OpenLineage/issues/4243) @​kchledowski Fix service provider interface conflicts caused by package relocation not updating META-INF/services configuration files.

1.42.0

Added

• DataZone transport: Add cross-region support [#4218](https://github.com/OpenLineage/OpenLineage/issues/4218) @​RohithKayathi Enable posting lineage events to DataZone domains in different regions from where data transformation jobs run.
• Spark: Add config for disabling RDD event emitting [#4118](https://github.com/OpenLineage/OpenLineage/issues/4118) @​kchledowski Add new configuration option spark.openlineage.filter.rddEventsDisabled to selectively disable OpenLineage event emission for RDD operations while keeping SQL-based operations enabled.
• Spark: Add schema and CLL facets for Snowflake writes [#4124](https://github.com/OpenLineage/OpenLineage/issues/4124) @​kchledowski Add schema and column-level lineage support for Snowflake datasets when using the Spark-Snowflake connector.
• Spark: Add spark.openlineage.applicationRunId override [#4215](https://github.com/OpenLineage/OpenLineage/issues/4215) @​wslulciuc Add support to override the application runID via the property spark.openlineage.applicationRunId.
• Spec: Add ExecutionParametersRunFacet [#4182](https://github.com/OpenLineage/OpenLineage/issues/4182) @​jakub-moravec Add a new facet to capture input parameters supplied to a job at the time of execution, enabling reproducibility, debugging, and richer lineage context.

Changed

• Java: Update GCP Lineage transport version and fix dependency shading [#3768](https://github.com/OpenLineage/OpenLineage/issues/3768) @​tnazarew Update GCP Lineage transport to use new version of the producer library with fixed dependency shading.
• Python: Show what transport failed to create [#4220](https://github.com/OpenLineage/OpenLineage/issues/4220) @​mobuchowski Improve error messages to indicate which transport failed to create.
• Spark: Prevent classloader issue by gating log behind additional flag [#4207](https://github.com/OpenLineage/OpenLineage/issues/4207) @​mobuchowski Fix classloader conflicts with BigQuery connector by gating DEBUG toJSON() logging behind an additional flag and logging exceptions.

Fixed

• Python: Fix .with_additional_properties() annotation [#4197](https://github.com/OpenLineage/OpenLineage/issues/4197) @​dolfinus Fix type annotation for .with_additional_properties() method to correctly accept keyword arguments.

... (truncated)

Commits

• 2cdaf7a Prepare for release 1.43.0
• 09182c9 changelog for release 1.43.0 (#4270)
• 2077f63 spark: Add support for DataSourceRDD with Iceberg (#4263)
• 7459368 build(deps): bump lodash from 4.17.21 to 4.17.23 in /website (#4267)
• 5264ba9 build(deps): bump tar from 7.5.3 to 7.5.6 in /website (#4266)
• 281b348 Fix isDeltaPlan() to handle multiple Spark extensions (#4268)
• 3f0e226 fix bigquery CLL namespace (#4264)
• 4f5ae1d build(deps): bump the client-java group in /client/java with 18 updates (#4234)
• 4e52601 build(deps): update sqlparser requirement from =0.59.0 to =0.60.0 in /integra...
• 0702e13 build(deps): bump the integration-spark group in /integration/spark with 28 u...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)