@@ -1934,8 +1934,8 @@ private[spark] class DAGScheduler(
1934
1934
* modify the scheduler's internal state. Use executorLost() to post a loss event from outside.
1935
1935
*
1936
1936
* We will also assume that we've lost all shuffle blocks associated with the executor if the
1937
- * executor serves its own blocks (i.e., we're not using external shuffle), or the Standalone
1938
- * worker (which serves the shuffle data) is lost.
1937
+ * executor serves its own blocks (i.e., we're not using an external shuffle service ), or the
1938
+ * entire Standalone worker is lost.
1939
1939
*/
1940
1940
private [scheduler] def handleExecutorLost (
1941
1941
execId : String ,
@@ -1958,9 +1958,8 @@ private[spark] class DAGScheduler(
1958
1958
* @param execId executor to be removed
1959
1959
* @param fileLost If true, indicates that we assume we've lost all shuffle blocks associated
1960
1960
* with the executor; this happens if the executor serves its own blocks (i.e., we're not
1961
- * using external shuffle), the Standalone worker (which serves the shuffle data) is lost,
1962
- * or a FetchFailed occurred (in which case we presume all shuffle data related to this
1963
- * executor to be lost).
1961
+ * using an external shuffle service), the entire Standalone worker is lost, or a FetchFailed
1962
+ * occurred (in which case we presume all shuffle data related to this executor to be lost).
1964
1963
* @param hostToUnregisterOutputs (optional) executor host if we're unregistering all the
1965
1964
* outputs on the host
1966
1965
* @param maybeEpoch (optional) the epoch during which the failure was caught (this prevents
0 commit comments