Skip to content

Commit 1a794bf

Browse files
LiupengchengJackey Lee
authored andcommitted
[SPARK-26529] Add debug logs for confArchive when preparing local resource
## What changes were proposed in this pull request? Currently, `Client#createConfArchive` do not handle IOException, and some detail info is not provided in logs. Sometimes, this may delay the time of locating the root cause of io error. This PR will add debug logs for confArchive when preparing local resource. ## How was this patch tested? unittest Closes apache#23444 from liupc/Add-logs-for-IOException-when-preparing-local-resource. Authored-by: Liupengcheng <liupengcheng@xiaomi.com> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
1 parent 10326f0 commit 1a794bf

File tree

1 file changed

+1
-0
lines changed
  • resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn

1 file changed

+1
-0
lines changed

resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -713,6 +713,7 @@ private[spark] class Client(
713713
new File(Utils.getLocalDir(sparkConf)))
714714
val confStream = new ZipOutputStream(new FileOutputStream(confArchive))
715715

716+
logDebug(s"Creating an archive with the config files for distribution at $confArchive.")
716717
try {
717718
confStream.setLevel(0)
718719

0 commit comments

Comments
 (0)