forked from delta-io/delta-sharing
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit ade390b
authored
fix(deps): update dependency io.delta:delta-sharing-spark_2.13 to v3.2.1 (#305)
This PR contains the following updates:
| Package | Change | Age | Adoption | Passing | Confidence |
|---|---|---|---|---|---|
| [io.delta:delta-sharing-spark_2.13](https://delta.io/)
([source](https://redirect.github.com/delta-io/delta)) | `3.2.0` ->
`3.2.1` |
[](https://docs.renovatebot.com/merge-confidence/)
|
[](https://docs.renovatebot.com/merge-confidence/)
|
[](https://docs.renovatebot.com/merge-confidence/)
|
[](https://docs.renovatebot.com/merge-confidence/)
|
---
### Release Notes
<details>
<summary>delta-io/delta (io.delta:delta-sharing-spark_2.13)</summary>
###
[`v3.2.1`](https://redirect.github.com/delta-io/delta/releases/tag/v3.2.1):
Delta Lake 3.2.1
We are excited to announce the release of Delta Lake 3.2.1! This release
contains important bug fixes to 3.2.0 and it is recommended that users
upgrade to 3.2.1.
Details by each component.
#### Delta Spark
Delta Spark 3.2.1 is built on [Apache Spark™
3.5.3](https://spark.apache.org/releases/spark-release-3-5-3.html).
Similar to Apache Spark, we have released Maven artifacts for both Scala
2.12 and Scala 2.13.
- Documentation: https://docs.delta.io/3.2.1/index.html
- API documentation:
https://docs.delta.io/3.2.1/delta-apidoc.html#delta-spark
- Artifacts:
[delta-spark\_2.12](https://repo1.maven.org/maven2/io/delta/delta-spark\_2.12/3.2.1/),
[delta-spark\_2.13](https://repo1.maven.org/maven2/io/delta/delta-spark\_2.13/3.2.1/),
[delta-contribs\_2.12](https://repo1.maven.org/maven2/io/delta/delta-contribs\_2.12/3.2.1/),
[delta_contribs\_2.13](https://repo1.maven.org/maven2/io/delta/delta-contribs\_2.13/3.2.1/),
[delta-storage](https://repo1.maven.org/maven2/io/delta/delta-storage/3.2.1/),
[delta-storage-s3-dynamodb](https://repo1.maven.org/maven2/io/delta/delta-storage-s3-dynamodb/3.2.1/)
The key changes of this release are:
- Support for Apache Spark™ 3.5.3.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3585) MERGE
operation not being recorded in QueryExecutionListener when submitted
through Scala/Python API.
- [Support](https://redirect.github.com/delta-io/delta/pull/3239)
RESTORE on a Delta table with clustering enabled
- [Fix](https://redirect.github.com/delta-io/delta/pull/3195) replacing
the clustered table with non-clustered table.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3121) an issue
when running clustering on table with single column selected as
clustering columns.
#### Delta Universal Format (UniForm)
- Documentation: https://docs.delta.io/3.2.1/delta-uniform.html
- Artifacts:
[delta-iceberg\_2.12](https://repo1.maven.org/maven2/io/delta/delta-iceberg\_2.12/3.2.1/),
[delta-iceberg\_2.13](https://repo1.maven.org/maven2/io/delta/delta-iceberg\_2.13/3.2.1/),
[delta-hudi\_2.12](https://repo1.maven.org/maven2/io/delta/delta-hudi\_2.12/3.2.1/),
[delta-hudi-2.13](https://repo1.maven.org/maven2/io/delta/delta-hudi\_2.13/3.2.1/)
The key changes of this release are:
- Added the support to enable Uniform Iceberg on existing Delta tables
by ALTER table instead of REORG, which rewrites data files.
- Fixed a bug that
[Uniform](https://redirect.github.com/delta-io/delta/pull/3618) iceberg
conversion transaction should not convert commit with only AddFiles
without data change
#### Delta Sharing Spark
- Documentation: https://docs.delta.io/3.2.1/delta-sharing.html
- Artifacts:
[delta-sharing-spark\_2.12](https://repo1.maven.org/maven2/io/delta/delta-sharing-spark\_2.12/3.2.1),
[delta-sharing-spark\_2.13](https://repo1.maven.org/maven2/io/delta/delta-sharing-spark\_2.13/3.2.1/)
The key changes of this release are:
- [Upgrade](https://redirect.github.com/delta-io/delta/pull/3493)
delta-sharing-client to version 1.1.1 which removes the pre-signed URL
address from the error message on access errors.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3433) an issue
with DeltaSharingLogFileStatus
#### Delta Kernel
- API documentation: https://docs.delta.io/3.2.1/delta-kernel.html
- Artifacts:
[delta-kernel-api](https://repo1.maven.org/maven2/io/delta/delta-kernel-api/3.2.1/),
[delta-kernel-defaults](https://repo1.maven.org/maven2/io/delta/delta-kernel-defaults/3.2.1/)
The key changes of this release are:
- [Fix](https://redirect.github.com/delta-io/delta/pull/3611) comparison
issues with string values having characters with surrogate pairs. This
fixes a corner case with wrong results when comparing characters (e.g.
emojis) that have surrogate pairs in UTF-16 representation.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3304)
ClassNotFoundException issue when loading LogStores in Kernel default
Engine module. This issue happens in some environments where the thread
local class loader is not set.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3291) error when
querying tables with spaces in the path name. Now you can query tables
with paths having any valid path characters.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3233) an issue
with writing decimal as binary when writing decimals with certain scale
and precision when writing them to the Parquet file.
- [Throw](https://redirect.github.com/delta-io/delta/pull/3196) proper
exception when unsupported VOID data type is encountered in Delta tables
when reading.
- [Handle](https://redirect.github.com/delta-io/delta/pull/3186) long
type values in field metadata of columns in schema. Earlier Kernel was
throwing a parsing exception, now Kernel handles long types.
- [Fix](https://redirect.github.com/delta-io/delta/pull/3086) an issue
where Kernel retries multiple times when \_last_checkpoint file is not
found. Now Kernel tries just once when file not found exception is
thrown.
- [Support](https://redirect.github.com/delta-io/delta/pull/3097)
reading Parquet files with legacy map type physical formats. Earlier
Kernel used to throw errors, now Kernel can read data from file
containing legacy map physical formats.
- [Support](https://redirect.github.com/delta-io/delta/pull/3083)
reading Parquet files with legacy 3-level repeated type physical
formats.
- [Write](https://redirect.github.com/delta-io/delta/pull/3084)
timestamp data to Parquet file as INT64 physical format instead of INT96
physical format. INT96 is a legacy physical format that is deprecated.
For more information, refer to:
- [User
guide](https://redirect.github.com/delta-io/delta/blob/branch-3.2/kernel/USER_GUIDE.md)
on step-by-step process of using Kernel in a standalone Java program or
in a distributed processing connector.
-
[Slides](https://docs.google.com/presentation/d/1PGSSuJ8ndghucSF9GpYgCi9oeRpWolFyehjQbPh92-U/edit)
explaining the rationale behind Kernel and the API design.
- Example [Java
programs](https://redirect.github.com/delta-io/delta/tree/branch-3.2/kernel/examples/table-reader/src/main/java/io/delta/kernel/examples)
that illustrate how to read Delta tables using the Kernel APIs.
- Table and default Engine API Java
[documentation](https://docs.delta.io/3.2.1/api/java/kernel/index.html)
#### Delta Standalone (deprecated in favor of Delta Kernel)
- API documentation: https://docs.delta.io/3.2.1/delta-standalone.html
-
Artifacts:[delta-standalone\_2.12](https://repo1.maven.org/maven2/io/delta/delta-standalone\_2.12/3.2.1/),
[delta-standalone\_2.13](https://repo1.maven.org/maven2/io/delta/delta-standalone\_2.13/3.2.1/)
This release does not update Standalone. Standalone is being deprecated
in favor of Delta Kernel, which supports advanced features in Delta
tables.
#### Delta Storage
Artifacts:
[delta-storage](https://repo1.maven.org/maven2/io/delta/delta-storage/3.2.1/),
[delta-storage-s3-dynamodb](https://repo1.maven.org/maven2/io/delta/delta-storage-s3-dynamodb/3.2.1/)
The key changes of this release are:
- [Fix](https://redirect.github.com/delta-io/delta/issues/3423) an issue
with VACUUM when using the S3DynamoDBLogStore where the LogStore made
unnecessary listFrom calls to DynamoDB, causing a
ProvisionedThroughputExceededException
#### Credits
Abhishek Radhakrishnan, Allison Portis, Charlene Lyu, Fred Storage Liu,
Jiaheng Tang, Johan Lasperas, Lin Zhou, Marko Ilić, Scott Sandre,
Tathagata Das, Tom van Bussel, Venki Korukanti, Wenchen Fan, Zihao Xu
</details>
---
### Configuration
📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).
🚦 **Automerge**: Disabled by config. Please merge this manually once you
are satisfied.
♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.
🔕 **Ignore**: Close this PR and you won't be reminded about this update
again.
---
- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box
---
This PR was generated by [Mend Renovate](https://mend.io/renovate/).
View the [repository job
log](https://developer.mend.io/github/agile-lab-dev/whitefox).
<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC45Ny4wIiwidXBkYXRlZEluVmVyIjoiMzguOTcuMCIsInRhcmdldEJyYW5jaCI6Im1haW4iLCJsYWJlbHMiOltdfQ==-->
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>1 parent 7f37c70 commit ade390bCopy full SHA for ade390b
1 file changed
+1
-1
lines changedwhitefox-platform/build.gradle.kts
Copy file name to clipboardExpand all lines: whitefox-platform/build.gradle.kts+1-1Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
19 | 19 |
| |
20 | 20 |
| |
21 | 21 |
| |
22 |
| - | |
| 22 | + | |
23 | 23 |
| |
24 | 24 |
| |
25 | 25 |
| |
|
0 commit comments