Skip to content

Commit

Permalink
SDC-13016. Include shuffle service enabled in defaults.
Browse files Browse the repository at this point in the history
Change-Id: I3177c3a32ccfcb8426c60ae8e9bdc1cb02f3a242
Reviewed-on: https://review.streamsets.net/c/datacollector/+/27883
Reviewed-by: Junko Urata <junko@streamsets.com>
  • Loading branch information
Hari Shreedharan committed Nov 25, 2019
1 parent e2c2df6 commit e456a64
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -1786,6 +1786,7 @@ private void setStreamingModeDefaults(PipelineConfiguration pipelineConfig) {
.add(ImmutableMap.of("key", "spark.executor.memory", "value","2G"))
.add(ImmutableMap.of("key", "spark.executor.cores", "value","1"))
.add(ImmutableMap.of("key", "spark.dynamicAllocation.enabled", "value", "true"))
.add(ImmutableMap.of("key", "spark.shuffle.service.enabled", "value", "true"))
.add(ImmutableMap.of("key", "spark.dynamicAllocation.minExecutors", "value", "1"))
.build();
Map<String, Config> replacementConfigs = ImmutableMap.<String, Config>builder()
Expand Down

0 comments on commit e456a64

Please sign in to comment.