Skip to content

Commit e6144e4

Browse files
committed
[SPARK-47695][BUILD] Upgrade AWS SDK v2 to 2.24.6
### What changes were proposed in this pull request? This PR aims to upgrade AWS SDK v2 to 2.24.6. ### Why are the changes needed? Like HADOOP-19082 (Apache Hadoop 3.4.1), Apache Spark 4.0.0 had better use the latest one. - apache/hadoop#6568 ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #45821 from dongjoon-hyun/SPARK-47695. Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
1 parent db0975c commit e6144e4

File tree

3 files changed

+13
-2
lines changed

3 files changed

+13
-2
lines changed

dev/deps/spark-deps-hadoop-3-hive-2.3

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ blas/3.0.3//blas-3.0.3.jar
3131
bonecp/0.8.0.RELEASE//bonecp-0.8.0.RELEASE.jar
3232
breeze-macros_2.13/2.1.0//breeze-macros_2.13-2.1.0.jar
3333
breeze_2.13/2.1.0//breeze_2.13-2.1.0.jar
34-
bundle/2.23.19//bundle-2.23.19.jar
34+
bundle/2.24.6//bundle-2.24.6.jar
3535
cats-kernel_2.13/2.8.0//cats-kernel_2.13-2.8.0.jar
3636
chill-java/0.10.0//chill-java-0.10.0.jar
3737
chill_2.13/0.10.0//chill_2.13-0.10.0.jar

hadoop-cloud/pom.xml

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,17 @@
7979
<version>${hadoop.version}</version>
8080
<scope>${hadoop.deps.scope}</scope>
8181
</dependency>
82+
<dependency>
83+
<groupId>software.amazon.awssdk</groupId>
84+
<artifactId>bundle</artifactId>
85+
<version>${aws.java.sdk.v2.version}</version>
86+
<exclusions>
87+
<exclusion>
88+
<groupId>*</groupId>
89+
<artifactId>*</artifactId>
90+
</exclusion>
91+
</exclusions>
92+
</dependency>
8293
<dependency>
8394
<groupId>com.google.cloud.bigdataoss</groupId>
8495
<artifactId>gcs-connector</artifactId>

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -160,7 +160,7 @@
160160
<aws.kinesis.client.version>1.12.0</aws.kinesis.client.version>
161161
<!-- Should be consistent with Kinesis client dependency -->
162162
<aws.java.sdk.version>1.11.655</aws.java.sdk.version>
163-
<aws.java.sdk.v2.version>2.23.19</aws.java.sdk.v2.version>
163+
<aws.java.sdk.v2.version>2.24.6</aws.java.sdk.v2.version>
164164
<!-- the producer is used in tests -->
165165
<aws.kinesis.producer.version>0.12.8</aws.kinesis.producer.version>
166166
<gcs-connector.version>hadoop3-2.2.20</gcs-connector.version>

0 commit comments

Comments
 (0)