Skip to content

Commit c3ca273

Browse files
committed
enhance condition for live stage
1 parent 7caf9d1 commit c3ca273

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

core/src/main/scala/org/apache/spark/status/AppStatusListener.scala

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -120,7 +120,8 @@ private[spark] class AppStatusListener(
120120
kvstore.view(classOf[StageDataWrapper]).asScala
121121
.filter { stageData =>
122122
stageData.info.status == v1.StageStatus.PENDING ||
123-
stageData.info.status == v1.StageStatus.ACTIVE
123+
stageData.info.status == v1.StageStatus.ACTIVE ||
124+
(stageData.info.numActiveTasks > 0 && stageData.info.status != v1.StageStatus.SKIPPED)
124125
}.map { stageData =>
125126
val stageId = stageData.info.stageId
126127
val jobs = liveJobs.values.filter(_.stageIds.contains(stageId)).toSeq

0 commit comments

Comments
 (0)