Commit 3d3dacb
kubernetes local should work with in process launcher (#601)
## Upstream SPARK-XXXXX ticket and PR link (if not applicable, explain)
local kubernetes submission is not submitted upstream yet
## What changes were proposed in this pull request?
In process launcher clobbers spark configuration with launcher port and secret overrides, resulting the local spark submit on the driver to connect to the port used by the cluster mode spark submit process.
Spark drivers in k8s are hard coded to run spark-submit, so spark launcher overrides are inapplicable to them. Excluding the configurations from the config map properly signals the local backend to not try to connect to a launcher server1 parent a7df826 commit 3d3dacb
File tree
1 file changed
+3
-1
lines changed- resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit
1 file changed
+3
-1
lines changedLines changed: 3 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
176 | 176 | | |
177 | 177 | | |
178 | 178 | | |
179 | | - | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
180 | 182 | | |
181 | 183 | | |
182 | 184 | | |
| |||
0 commit comments