Skip to content

Commit

Permalink
[SPARK-37102][BUILD] Removed redundant exclusions in hadoop-cloud m…
Browse files Browse the repository at this point in the history
…odule

### What changes were proposed in this pull request?
Redundant exclusions were removed for hadoop-cloud module so the build output contains required dependency for hadoop-azure artifact (ackson-mapper-asl).

### Why are the changes needed?
Currently Hadoop ABFS connector (for Azure Data Lake Storage Gen2) is broken due to missing dependency. So required dependencies for hadoop-azure artifact should be included into distribution output if hadoop-cloud module enabled.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
Unfortunately Microsoft does not provide support for Data Lake Storage Gen2 within azurite emulator - so the change was tested manually and the diff was checked to see if anything else was picked up for build outputs (before and after the change). So the only change is inclusion of jackson-mapper-asl-1.9.13.jar.

Closes apache#34383 from vmalakhin/SPARK-37102.

Lead-authored-by: Vasily Malakhin <vmalakhin@gmail.com>
Co-authored-by: vmalakhin <49170798+vmalakhin@users.noreply.github.com>
Signed-off-by: Sean Owen <srowen@gmail.com>
  • Loading branch information
2 people authored and srowen committed Oct 30, 2021
1 parent 6fd93b3 commit 6906328
Showing 1 changed file with 0 additions and 16 deletions.
16 changes: 0 additions & 16 deletions hadoop-cloud/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -85,14 +85,6 @@
<groupId>commons-logging</groupId>
<artifactId>commons-logging</artifactId>
</exclusion>
<exclusion>
<groupId>org.codehaus.jackson</groupId>
<artifactId>jackson-mapper-asl</artifactId>
</exclusion>
<exclusion>
<groupId>org.codehaus.jackson</groupId>
<artifactId>jackson-core-asl</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
Expand Down Expand Up @@ -184,10 +176,6 @@
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
</exclusion>
<exclusion>
<groupId>org.codehaus.jackson</groupId>
<artifactId>jackson-mapper-asl</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
Expand Down Expand Up @@ -271,10 +259,6 @@
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
</exclusion>
<exclusion>
<groupId>org.codehaus.jackson</groupId>
<artifactId>jackson-mapper-asl</artifactId>
</exclusion>
<exclusion>
<groupId>com.fasterxml.jackson.core</groupId>
<artifactId>jackson-core</artifactId>
Expand Down

0 comments on commit 6906328

Please sign in to comment.