Skip to content

Commit 340e07c

Browse files
committed
[SPARK][CORE] NoClassDefFoundError will not be catch up which will cause job hung
1 parent f6e6899 commit 340e07c

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1049,6 +1049,13 @@ class DAGScheduler(
10491049
abortStage(stage, s"Task serialization failed: $e\n${Utils.exceptionString(e)}", Some(e))
10501050
runningStages -= stage
10511051
return
1052+
1053+
case e: NoClassDefFoundError =>
1054+
abortStage(stage, s"Task serialization failed: $e\n${Utils.exceptionString(e)}", Some(e))
1055+
runningStages -= stage
1056+
1057+
// Abort execution
1058+
return
10521059
}
10531060

10541061
val tasks: Seq[Task[_]] = try {

0 commit comments

Comments
 (0)