Skip to content

Commit f4a9c41

Browse files
KaiXinXiaoLeiAndrew Or
KaiXinXiaoLei
authored and
Andrew Or
committed
[CORE] The descriptionof jobHistory config should be spark.history.fs.logDirectory
The config option is spark.history.fs.logDirectory, not spark.fs.history.logDirectory. So the descriptionof should be changed. Thanks. Author: KaiXinXiaoLei <huleilei1@huawei.com> Closes #5332 from KaiXinXiaoLei/historyConfig and squashes the following commits: 5ffbfb5 [KaiXinXiaoLei] the describe of jobHistory config is error (cherry picked from commit 8a0aa81) Signed-off-by: Andrew Or <andrew@databricks.com>
1 parent 2991dd0 commit f4a9c41

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

core/src/main/scala/org/apache/spark/deploy/history/FsHistoryProvider.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ private[history] class FsHistoryProvider(conf: SparkConf) extends ApplicationHis
9696
if (!fs.exists(path)) {
9797
var msg = s"Log directory specified does not exist: $logDir."
9898
if (logDir == DEFAULT_LOG_DIR) {
99-
msg += " Did you configure the correct one through spark.fs.history.logDirectory?"
99+
msg += " Did you configure the correct one through spark.history.fs.logDirectory?"
100100
}
101101
throw new IllegalArgumentException(msg)
102102
}

0 commit comments

Comments
 (0)