Skip to content

Commit 7dde80e

Browse files
holdenkattilapiros
andauthored
Update core/src/main/scala/org/apache/spark/shuffle/IndexShuffleBlockResolver.scala
If we have a failure during block migration, log the exception. Co-authored-by: Attila Zsolt Piros <2017933+attilapiros@users.noreply.github.com>
1 parent b2da4c5 commit 7dde80e

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

core/src/main/scala/org/apache/spark/shuffle/IndexShuffleBlockResolver.scala

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -226,6 +226,7 @@ private[spark] class IndexShuffleBlockResolver(
226226

227227
override def onFailure(streamId: String, cause: Throwable): Unit = {
228228
// the framework handles the connection itself, we just need to do local cleanup
229+
logWarning(s"Error while uploading $blockId", cause)
229230
channel.close()
230231
fileTmp.delete()
231232
}

0 commit comments

Comments
 (0)