-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Build: Bump parquet from 1.13.1 to 1.14.3 #11264
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
|
@dependabot rebase |
b9f6809 to
1d3d3e5
Compare
1d3d3e5 to
9d58865
Compare
nastra
reviewed
Oct 18, 2024
| Row binaryCol = | ||
| Row.of( | ||
| 52L, | ||
| 55L, |
Contributor
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks like column sizes got slightly larger:
Parquet 1.13.1
% parquet-cli/1.14.3/bin/parquet column-size old-version.parquet
binaryCol-> Size In Bytes: 52 Size In Ratio: 0.08695652
intCol-> Size In Bytes: 71 Size In Ratio: 0.1187291
decimalCol-> Size In Bytes: 85 Size In Ratio: 0.14214046
fixedCol-> Size In Bytes: 44 Size In Ratio: 0.073578596
booleanCol-> Size In Bytes: 32 Size In Ratio: 0.053511705
stringCol-> Size In Bytes: 79 Size In Ratio: 0.13210702
floatCol-> Size In Bytes: 71 Size In Ratio: 0.1187291
longCol-> Size In Bytes: 79 Size In Ratio: 0.13210702
doubleCol-> Size In Bytes: 85 Size In Ratio: 0.14214046
Parquet 1.14.3
% parquet-cli/1.14.3/bin/parquet column-size new-version.parquet
binaryCol-> Size In Bytes: 55 Size In Ratio: 0.085403726
intCol-> Size In Bytes: 77 Size In Ratio: 0.11956522
decimalCol-> Size In Bytes: 91 Size In Ratio: 0.14130434
fixedCol-> Size In Bytes: 47 Size In Ratio: 0.072981365
booleanCol-> Size In Bytes: 36 Size In Ratio: 0.055900622
stringCol-> Size In Bytes: 85 Size In Ratio: 0.13198757
floatCol-> Size In Bytes: 77 Size In Ratio: 0.11956522
longCol-> Size In Bytes: 85 Size In Ratio: 0.13198757
doubleCol-> Size In Bytes: 91 Size In Ratio: 0.14130434
findepi
approved these changes
Oct 18, 2024
Member
|
thank you @nastra ! |
RussellSpitzer
added a commit
to RussellSpitzer/iceberg
that referenced
this pull request
Nov 4, 2024
This reverts commit b8c2b20. apache/parquet-java#3040 Was discovered by @pan3793 in Parquet 1.14.(0,1,2,3).
RussellSpitzer
added a commit
that referenced
this pull request
Nov 4, 2024
This reverts commit b8c2b20. apache/parquet-java#3040 Was discovered by @pan3793 in Parquet 1.14.(0,1,2,3).
RussellSpitzer
added a commit
to RussellSpitzer/iceberg
that referenced
this pull request
Nov 4, 2024
…ache#11462) This reverts commit b8c2b20. apache/parquet-java#3040 Was discovered by @pan3793 in Parquet 1.14.(0,1,2,3).
RussellSpitzer
added a commit
that referenced
this pull request
Nov 4, 2024
This reverts commit b8c2b20. apache/parquet-java#3040 Was discovered by @pan3793 in Parquet 1.14.(0,1,2,3).
Fokko
added a commit
to Fokko/iceberg
that referenced
this pull request
Nov 8, 2024
…)" (apache#11462)" This reverts commit 7cc16fa.
Fokko
added a commit
that referenced
this pull request
Nov 20, 2024
zachdisc
pushed a commit
to zachdisc/iceberg
that referenced
this pull request
Dec 23, 2024
Co-authored-by: Eduard Tudenhoefner <etudenhoefner@gmail.com>
zachdisc
pushed a commit
to zachdisc/iceberg
that referenced
this pull request
Dec 23, 2024
…ache#11462) This reverts commit b8c2b20. apache/parquet-java#3040 Was discovered by @pan3793 in Parquet 1.14.(0,1,2,3).
zachdisc
pushed a commit
to zachdisc/iceberg
that referenced
this pull request
Dec 23, 2024
* Revert "Revert "Build: Bump parquet from 1.13.1 to 1.14.3 (apache#11264)" (apache#11462)" This reverts commit 7cc16fa. * Bump to Parquet 1.14.4 * Lookup sizes instead * Update build.gradle
This was referenced Apr 14, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
dependencies
Pull requests that update a dependency file
flink
java
Pull requests that update Java code
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Bumps
parquetfrom 1.13.1 to 1.14.3.Updates
org.apache.parquet:parquet-avrofrom 1.13.1 to 1.14.3Release notes
Sourced from org.apache.parquet:parquet-avro's releases.
... (truncated)
Changelog
Sourced from org.apache.parquet:parquet-avro's changelog.
... (truncated)
Commits
b5e376a[maven-release-plugin] prepare release apache-parquet-1.14.3-rc27d970b7GH-3021: Upgrade Avro dependency (#3022)4257337[maven-release-plugin] prepare for next development iterationcf1efcc[maven-release-plugin] prepare release apache-parquet-1.14.3-rc0b1475a7GH-3013: Fix potential ClassCastException at reading DELTA_BYTE_ARRAY encodin...aec24e7MINOR: Don't run all the tests on a release (#2999)2734728GH-3007: Ensure version specific Jackson classes are shaded (#3017)7b6753dMINOR: fix version of parquet-pluginsdde627cPrepare for next development iteration2245b30[maven-release-plugin] prepare for next development iterationUpdates
org.apache.parquet:parquet-columnfrom 1.13.1 to 1.14.3Release notes
Sourced from org.apache.parquet:parquet-column's releases.
... (truncated)
Changelog
Sourced from org.apache.parquet:parquet-column's changelog.
... (truncated)
Commits
b5e376a[maven-release-plugin] prepare release apache-parquet-1.14.3-rc27d970b7GH-3021: Upgrade Avro dependency (#3022)4257337[maven-release-plugin] prepare for next development iterationcf1efcc[maven-release-plugin] prepare release apache-parquet-1.14.3-rc0b1475a7GH-3013: Fix potential ClassCastException at reading DELTA_BYTE_ARRAY encodin...aec24e7MINOR: Don't run all the tests on a release (#2999)2734728GH-3007: Ensure version specific Jackson classes are shaded (#3017)7b6753dMINOR: fix version of parquet-pluginsdde627cPrepare for next development iteration2245b30[maven-release-plugin] prepare for next development iterationUpdates
org.apache.parquet:parquet-hadoopfrom 1.13.1 to 1.14.3Release notes
Sourced from org.apache.parquet:parquet-hadoop's releases.
... (truncated)
Changelog
Sourced from org.apache.parquet:parquet-hadoop's changelog.
... (truncated)
Commits
b5e376a[maven-release-plugin] prepare release apache-parquet-1.14.3-rc27d970b7GH-3021: Upgrade Avro dependency (#3022)4257337[maven-release-plugin] prepare for next development iterationcf1efcc[maven-release-plugin] prepare release apache-parquet-1.14.3-rc0b1475a7GH-3013: Fix potential ClassCastException at reading DELTA_BYTE_ARRAY encodin...aec24e7MINOR: Don't run all the tests on a release (#2999)2734728GH-3007: Ensure version specific Jackson classes are shaded (#3017)7b6753dMINOR: fix version of parquet-pluginsdde627cPrepare for next development iteration2245b30[maven-release-plugin] prepare for next development iterationDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebasewill rebase this PR@dependabot recreatewill recreate this PR, overwriting any edits that have been made to it@dependabot mergewill merge this PR after your CI passes on it@dependabot squash and mergewill squash and merge this PR after your CI passes on it@dependabot cancel mergewill cancel a previously requested merge and block automerging@dependabot reopenwill reopen this PR if it is closed@dependabot closewill close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually@dependabot show <dependency name> ignore conditionswill show all of the ignore conditions of the specified dependency@dependabot ignore this major versionwill close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor versionwill close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependencywill close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)