Skip to content

Commit

Permalink
[SPARK-36451][BUILD] Ivy skips looking for source and doc pom
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
Because SPARK-35863 Upgrade Ivy to 2.5.0, it supports skip searching the source and doc pom, but the remote repo will still be queried at present.

### Why are the changes needed?
Can improve the speed of some UT, such as `IsolatedClientLoader#downloadVersion`, no need to find source and doc pom

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
manual UT

Closes apache#33678 from cxzl25/SPARK-36451.

Authored-by: sychen <sychen@ctrip.com>
Signed-off-by: Sean Owen <srowen@gmail.com>
  • Loading branch information
cxzl25 authored and srowen committed Aug 18, 2021
1 parent 281b00a commit a1ecf83
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
Original file line number Diff line number Diff line change
Expand Up @@ -1282,6 +1282,12 @@ private[spark] object SparkSubmitUtils extends Logging {
ivySettings.addResolver(repoResolver)
ivySettings.setDefaultResolver(repoResolver.getName)
processRemoteRepoArg(ivySettings, remoteRepos)
// (since 2.5) Setting the property ivy.maven.lookup.sources to false
// disables the lookup of the sources artifact.
// And setting the property ivy.maven.lookup.javadoc to false
// disables the lookup of the javadoc artifact.
ivySettings.setVariable("ivy.maven.lookup.sources", "false")
ivySettings.setVariable("ivy.maven.lookup.javadoc", "false")
ivySettings
}

Expand Down

0 comments on commit a1ecf83

Please sign in to comment.