File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed
core/src/main/scala/org/apache/spark/scheduler Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -189,9 +189,9 @@ private[spark] class DAGScheduler(
189
189
* Tracks the latest epoch of a fully processed error where shuffle files have been lost from
190
190
* the given executor.
191
191
*
192
- * This is closely related to executorFailureEpoch.
193
- * They only differ for the executor when there is a Standalone worker or an external shuffle
194
- * service serving shuffle files . In that case, when an executor is lost, we do not update
192
+ * This is closely related to executorFailureEpoch. They only differ for the executor when
193
+ * there is an external shuffle service serving shuffle files and we haven't been notified that
194
+ * the entire worker has been lost . In that case, when an executor is lost, we do not update
195
195
* the shuffleFileLostEpoch; we wait for a fetch failure. This way, if only the executor
196
196
* fails, we do not unregister the shuffle data as it can still be served; but if there is
197
197
* a failure in the shuffle service (resulting in fetch failure), we unregister the shuffle
You can’t perform that action at this time.
0 commit comments