Skip to content

Commit ade390b

Browse files
fix(deps): update dependency io.delta:delta-sharing-spark_2.13 to v3.2.1 (#305)
This PR contains the following updates: | Package | Change | Age | Adoption | Passing | Confidence | |---|---|---|---|---|---| | [io.delta:delta-sharing-spark_2.13](https://delta.io/) ([source](https://redirect.github.com/delta-io/delta)) | `3.2.0` -> `3.2.1` | [![age](https://developer.mend.io/api/mc/badges/age/maven/io.delta:delta-sharing-spark_2.13/3.2.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![adoption](https://developer.mend.io/api/mc/badges/adoption/maven/io.delta:delta-sharing-spark_2.13/3.2.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![passing](https://developer.mend.io/api/mc/badges/compatibility/maven/io.delta:delta-sharing-spark_2.13/3.2.0/3.2.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | [![confidence](https://developer.mend.io/api/mc/badges/confidence/maven/io.delta:delta-sharing-spark_2.13/3.2.0/3.2.1?slim=true)](https://docs.renovatebot.com/merge-confidence/) | --- ### Release Notes <details> <summary>delta-io/delta (io.delta:delta-sharing-spark_2.13)</summary> ### [`v3.2.1`](https://redirect.github.com/delta-io/delta/releases/tag/v3.2.1): Delta Lake 3.2.1 We are excited to announce the release of Delta Lake 3.2.1! This release contains important bug fixes to 3.2.0 and it is recommended that users upgrade to 3.2.1. Details by each component. #### Delta Spark Delta Spark 3.2.1 is built on [Apache Spark™ 3.5.3](https://spark.apache.org/releases/spark-release-3-5-3.html). Similar to Apache Spark, we have released Maven artifacts for both Scala 2.12 and Scala 2.13. - Documentation: https://docs.delta.io/3.2.1/index.html - API documentation: https://docs.delta.io/3.2.1/delta-apidoc.html#delta-spark - Artifacts: [delta-spark\_2.12](https://repo1.maven.org/maven2/io/delta/delta-spark\_2.12/3.2.1/), [delta-spark\_2.13](https://repo1.maven.org/maven2/io/delta/delta-spark\_2.13/3.2.1/), [delta-contribs\_2.12](https://repo1.maven.org/maven2/io/delta/delta-contribs\_2.12/3.2.1/), [delta_contribs\_2.13](https://repo1.maven.org/maven2/io/delta/delta-contribs\_2.13/3.2.1/), [delta-storage](https://repo1.maven.org/maven2/io/delta/delta-storage/3.2.1/), [delta-storage-s3-dynamodb](https://repo1.maven.org/maven2/io/delta/delta-storage-s3-dynamodb/3.2.1/) The key changes of this release are: - Support for Apache Spark™ 3.5.3. - [Fix](https://redirect.github.com/delta-io/delta/pull/3585) MERGE operation not being recorded in QueryExecutionListener when submitted through Scala/Python API. - [Support](https://redirect.github.com/delta-io/delta/pull/3239) RESTORE on a Delta table with clustering enabled - [Fix](https://redirect.github.com/delta-io/delta/pull/3195) replacing the clustered table with non-clustered table. - [Fix](https://redirect.github.com/delta-io/delta/pull/3121) an issue when running clustering on table with single column selected as clustering columns. #### Delta Universal Format (UniForm) - Documentation: https://docs.delta.io/3.2.1/delta-uniform.html - Artifacts: [delta-iceberg\_2.12](https://repo1.maven.org/maven2/io/delta/delta-iceberg\_2.12/3.2.1/), [delta-iceberg\_2.13](https://repo1.maven.org/maven2/io/delta/delta-iceberg\_2.13/3.2.1/), [delta-hudi\_2.12](https://repo1.maven.org/maven2/io/delta/delta-hudi\_2.12/3.2.1/), [delta-hudi-2.13](https://repo1.maven.org/maven2/io/delta/delta-hudi\_2.13/3.2.1/) The key changes of this release are: - Added the support to enable Uniform Iceberg on existing Delta tables by ALTER table instead of REORG, which rewrites data files. - Fixed a bug that [Uniform](https://redirect.github.com/delta-io/delta/pull/3618) iceberg conversion transaction should not convert commit with only AddFiles without data change #### Delta Sharing Spark - Documentation: https://docs.delta.io/3.2.1/delta-sharing.html - Artifacts: [delta-sharing-spark\_2.12](https://repo1.maven.org/maven2/io/delta/delta-sharing-spark\_2.12/3.2.1), [delta-sharing-spark\_2.13](https://repo1.maven.org/maven2/io/delta/delta-sharing-spark\_2.13/3.2.1/) The key changes of this release are: - [Upgrade](https://redirect.github.com/delta-io/delta/pull/3493) delta-sharing-client to version 1.1.1 which removes the pre-signed URL address from the error message on access errors. - [Fix](https://redirect.github.com/delta-io/delta/pull/3433) an issue with DeltaSharingLogFileStatus #### Delta Kernel - API documentation: https://docs.delta.io/3.2.1/delta-kernel.html - Artifacts: [delta-kernel-api](https://repo1.maven.org/maven2/io/delta/delta-kernel-api/3.2.1/), [delta-kernel-defaults](https://repo1.maven.org/maven2/io/delta/delta-kernel-defaults/3.2.1/) The key changes of this release are: - [Fix](https://redirect.github.com/delta-io/delta/pull/3611) comparison issues with string values having characters with surrogate pairs. This fixes a corner case with wrong results when comparing characters (e.g. emojis) that have surrogate pairs in UTF-16 representation. - [Fix](https://redirect.github.com/delta-io/delta/pull/3304) ClassNotFoundException issue when loading LogStores in Kernel default Engine module. This issue happens in some environments where the thread local class loader is not set. - [Fix](https://redirect.github.com/delta-io/delta/pull/3291) error when querying tables with spaces in the path name. Now you can query tables with paths having any valid path characters. - [Fix](https://redirect.github.com/delta-io/delta/pull/3233) an issue with writing decimal as binary when writing decimals with certain scale and precision when writing them to the Parquet file. - [Throw](https://redirect.github.com/delta-io/delta/pull/3196) proper exception when unsupported VOID data type is encountered in Delta tables when reading. - [Handle](https://redirect.github.com/delta-io/delta/pull/3186) long type values in field metadata of columns in schema. Earlier Kernel was throwing a parsing exception, now Kernel handles long types. - [Fix](https://redirect.github.com/delta-io/delta/pull/3086) an issue where Kernel retries multiple times when \_last_checkpoint file is not found. Now Kernel tries just once when file not found exception is thrown. - [Support](https://redirect.github.com/delta-io/delta/pull/3097) reading Parquet files with legacy map type physical formats. Earlier Kernel used to throw errors, now Kernel can read data from file containing legacy map physical formats. - [Support](https://redirect.github.com/delta-io/delta/pull/3083) reading Parquet files with legacy 3-level repeated type physical formats. - [Write](https://redirect.github.com/delta-io/delta/pull/3084) timestamp data to Parquet file as INT64 physical format instead of INT96 physical format. INT96 is a legacy physical format that is deprecated. For more information, refer to: - [User guide](https://redirect.github.com/delta-io/delta/blob/branch-3.2/kernel/USER_GUIDE.md) on step-by-step process of using Kernel in a standalone Java program or in a distributed processing connector. - [Slides](https://docs.google.com/presentation/d/1PGSSuJ8ndghucSF9GpYgCi9oeRpWolFyehjQbPh92-U/edit) explaining the rationale behind Kernel and the API design. - Example [Java programs](https://redirect.github.com/delta-io/delta/tree/branch-3.2/kernel/examples/table-reader/src/main/java/io/delta/kernel/examples) that illustrate how to read Delta tables using the Kernel APIs. - Table and default Engine API Java [documentation](https://docs.delta.io/3.2.1/api/java/kernel/index.html) #### Delta Standalone (deprecated in favor of Delta Kernel) - API documentation: https://docs.delta.io/3.2.1/delta-standalone.html - Artifacts:[delta-standalone\_2.12](https://repo1.maven.org/maven2/io/delta/delta-standalone\_2.12/3.2.1/), [delta-standalone\_2.13](https://repo1.maven.org/maven2/io/delta/delta-standalone\_2.13/3.2.1/) This release does not update Standalone. Standalone is being deprecated in favor of Delta Kernel, which supports advanced features in Delta tables. #### Delta Storage Artifacts: [delta-storage](https://repo1.maven.org/maven2/io/delta/delta-storage/3.2.1/), [delta-storage-s3-dynamodb](https://repo1.maven.org/maven2/io/delta/delta-storage-s3-dynamodb/3.2.1/) The key changes of this release are: - [Fix](https://redirect.github.com/delta-io/delta/issues/3423) an issue with VACUUM when using the S3DynamoDBLogStore where the LogStore made unnecessary listFrom calls to DynamoDB, causing a ProvisionedThroughputExceededException #### Credits Abhishek Radhakrishnan, Allison Portis, Charlene Lyu, Fred Storage Liu, Jiaheng Tang, Johan Lasperas, Lin Zhou, Marko Ilić, Scott Sandre, Tathagata Das, Tom van Bussel, Venki Korukanti, Wenchen Fan, Zihao Xu </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR was generated by [Mend Renovate](https://mend.io/renovate/). View the [repository job log](https://developer.mend.io/github/agile-lab-dev/whitefox). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC45Ny4wIiwidXBkYXRlZEluVmVyIjoiMzguOTcuMCIsInRhcmdldEJyYW5jaCI6Im1haW4iLCJsYWJlbHMiOltdfQ==--> Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
1 parent 7f37c70 commit ade390b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

whitefox-platform/build.gradle.kts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ dependencies {
1919
api("org.apache.hadoop:hadoop-client-api:3.4.0")
2020
api("org.apache.hadoop:hadoop-client-runtime:3.4.0")
2121
api("io.delta:delta-standalone_2.13:3.2.0")
22-
api("io.delta:delta-sharing-spark_2.13:3.2.0")
22+
api("io.delta:delta-sharing-spark_2.13:3.2.1")
2323
api("org.apache.spark:spark-sql_2.13:3.5.1")
2424
api("org.apache.iceberg:iceberg-api:1.6.1")
2525
api("org.apache.iceberg:iceberg-core:1.5.2")

0 commit comments

Comments
 (0)