Skip to content

Commit 55307f5

Browse files
committed
MapR [SPARK-1216] java.net.URISyntaxException: Relative path in absolute URI: ${system:user.name%7D (apache#1136)
Co-authored-by: Egor Krivokon <>
1 parent cb1379c commit 55307f5

File tree

2 files changed

+8
-3
lines changed

2 files changed

+8
-3
lines changed

bin/configure.sh

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -491,6 +491,13 @@ function registerServicePorts() {
491491
registerPortHistoryServer
492492
}
493493

494+
function configureHiveWarehouseForNonHiveEnv() {
495+
cat >> "$SPARK_HOME"/conf/spark-defaults.conf << EOM
496+
# Default location for Warehouse, if not using Hive
497+
EOM
498+
changeSparkDefaults "spark.sql.warehouse.dir" "maprfs:///user/${USER}/spark-warehouse"
499+
}
500+
494501
#
495502
# Add warden files
496503
#
@@ -638,6 +645,7 @@ done
638645
mkBackupForOldConfigs
639646

640647
registerServicePorts
648+
configureHiveWarehouseForNonHiveEnv
641649
if [ "$HIVE_INSTALLED" = true ]; then
642650
configureOnHive
643651
fi

conf/spark-defaults.conf

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -9,9 +9,6 @@ spark.eventLog.enabled true
99
spark.eventLog.dir maprfs:///apps/spark
1010
spark.history.fs.logDirectory maprfs:///apps/spark
1111

12-
# Default location for Warehouse, if not using Hive
13-
spark.sql.warehouse.dir maprfs:///user/${system:user.name}/spark-warehouse
14-
1512
# Fix for SPARK-963 restore the behavior before Spark 3.2
1613
spark.hadoopRDD.ignoreEmptySplits false
1714

0 commit comments

Comments
 (0)