Skip to content

Commit 56f3ae5

Browse files
committed
[SPARK-32003] One more comment tweak.
1 parent 4301291 commit 56f3ae5

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -189,9 +189,9 @@ private[spark] class DAGScheduler(
189189
* Tracks the latest epoch of a fully processed error where shuffle files have been lost from
190190
* the given executor.
191191
*
192-
* This is closely related to executorFailureEpoch.
193-
* They only differ for the executor when there is a Standalone worker or an external shuffle
194-
* service serving shuffle files. In that case, when an executor is lost, we do not update
192+
* This is closely related to executorFailureEpoch. They only differ for the executor when
193+
* there is an external shuffle service serving shuffle files and we haven't been notified that
194+
* the entire worker has been lost. In that case, when an executor is lost, we do not update
195195
* the shuffleFileLostEpoch; we wait for a fetch failure. This way, if only the executor
196196
* fails, we do not unregister the shuffle data as it can still be served; but if there is
197197
* a failure in the shuffle service (resulting in fetch failure), we unregister the shuffle

0 commit comments

Comments
 (0)