Skip to content

chore(hive): Bump dependencies ahead of 25.7.0 #1100

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ All notable changes to this project will be documented in this file.
- yq: Bump products to use `4.45.2` ([#1090]).
- cyclonedx-bom: Bump airflow and superset to use `6.0.0` ([#1090]).
- vector: Bump to `0.46.1` ([#1098]).
- hive: Bump Hadoop to 3.4.1, and AWS bundle to 2.24.6 ([#1100]).

### Fixed

Expand Down Expand Up @@ -90,6 +91,7 @@ All notable changes to this project will be documented in this file.
[#1093]: https://github.com/stackabletech/docker-images/pull/1093
[#1097]: https://github.com/stackabletech/docker-images/pull/1097
[#1098]: https://github.com/stackabletech/docker-images/pull/1098
[#1100]: https://github.com/stackabletech/docker-images/pull/1100

## [25.3.0] - 2025-03-21

Expand Down
4 changes: 3 additions & 1 deletion hive/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,9 @@ ln -s "/stackable/jmx/jmx_prometheus_javaagent-${JMX_EXPORTER}.jar" /stackable/j

# Add S3 Support for Hive (support for s3a://)
cp /stackable/hadoop-${HADOOP}/share/hadoop/tools/lib/hadoop-aws-${HADOOP}.jar /stackable/apache-hive-metastore-${PRODUCT}-bin/lib/
cp /stackable/hadoop-${HADOOP}/share/hadoop/tools/lib/aws-java-sdk-bundle-${AWS_JAVA_SDK_BUNDLE}.jar /stackable/apache-hive-metastore-${PRODUCT}-bin/lib/
# According to https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/aws_sdk_upgrade.html, the jar filename has changed from
# aws-java-sdk-bundle-${AWS_JAVA_SDK_BUNDLE}.jar to bundle-${AWS_JAVA_SDK_BUNDLE}.jar
cp /stackable/hadoop-${HADOOP}/share/hadoop/tools/lib/bundle-${AWS_JAVA_SDK_BUNDLE}.jar /stackable/apache-hive-metastore-${PRODUCT}-bin/lib/

# Add Azure ABFS support (support for abfs://)
cp /stackable/hadoop-${HADOOP}/share/hadoop/tools/lib/hadoop-azure-${HADOOP}.jar /stackable/apache-hive-metastore-${PRODUCT}-bin/lib/
Expand Down
18 changes: 9 additions & 9 deletions hive/versions.py
Original file line number Diff line number Diff line change
Expand Up @@ -5,9 +5,9 @@
# Hive 3 must be built with Java 8 but will run on Java 11
"java-base": "11",
"java-devel": "8",
"hadoop": "3.3.6",
# Keep consistent with the dependency from Hadoop: https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.3.6
"aws_java_sdk_bundle": "1.12.367",
"hadoop": "3.4.1",
# Keep consistent with the dependency from Hadoop: https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.4.1
"aws_java_sdk_bundle": "2.24.6",
"azure_storage": "7.0.1",
"azure_keyvault_core": "1.0.0",
},
Expand All @@ -17,9 +17,9 @@
# Hive 4 must be built with Java 8 (according to GitHub README) but seems to run on Java 11
"java-base": "11",
"java-devel": "8",
"hadoop": "3.3.6",
# Keep consistent with the dependency from Hadoop: https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.3.6
"aws_java_sdk_bundle": "1.12.367",
"hadoop": "3.4.1",
# Keep consistent with the dependency from Hadoop: https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.4.1
"aws_java_sdk_bundle": "2.24.6",
"azure_storage": "7.0.1",
"azure_keyvault_core": "1.0.0",
},
Expand All @@ -29,9 +29,9 @@
# Hive 4 must be built with Java 8 (according to GitHub README) but seems to run on Java 11
"java-base": "11",
"java-devel": "8",
"hadoop": "3.3.6",
# Keep consistent with the dependency from Hadoop: https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.3.6
"aws_java_sdk_bundle": "1.12.367",
"hadoop": "3.4.1",
# Keep consistent with the dependency from Hadoop: https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/3.4.1
"aws_java_sdk_bundle": "2.24.6",
"azure_storage": "7.0.1",
"azure_keyvault_core": "1.0.0",
},
Expand Down
2 changes: 1 addition & 1 deletion java-base/versions.py
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,6 @@
},
{
"product": "24",
"vector": "0.43.1",
"vector": "0.46.1",
},
]