Skip to content

Commit 3a5475e

Browse files
author
Vladimir Kichaev
committed
Removed custom Java installation and added some option to spark-submit
1 parent 30defe7 commit 3a5475e

File tree

1 file changed

+1
-7
lines changed

1 file changed

+1
-7
lines changed

.github/workflows/build.yml

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -50,14 +50,8 @@ jobs:
5050
curl -OL https://archive.apache.org/dist/hadoop/core/hadoop-${HADOOP_VERSION}/hadoop-${HADOOP_VERSION}.tar.gz
5151
tar -xzf hadoop-${HADOOP_VERSION}.tar.gz
5252
53-
- name: Install Java
54-
uses: actions/setup-java@v3
55-
with:
56-
distribution: 'zulu'
57-
java-version: '8'
58-
5953
- name: Run tests
6054
run: |
6155
export SPARK_DIST_CLASSPATH=$PWD/slf4j-api-${SFL4J_VERSION}.jar:$(hadoop-${HADOOP_VERSION}/bin/hadoop classpath)
6256
export PATH="$PWD/spark-${SPARK_VERSION}-bin-without-hadoop/bin:$PATH"
63-
spark-submit -v --packages com.amazonaws:aws-java-sdk:1.11.920,org.apache.hadoop:hadoop-aws:2.8.4 bazel-bin/apps/hello/sparkle-example-hello_deploy.jar
57+
spark-submit -v --executor-cores 1 --packages com.amazonaws:aws-java-sdk:1.11.920,org.apache.hadoop:hadoop-aws:2.8.4 bazel-bin/apps/hello/sparkle-example-hello_deploy.jar

0 commit comments

Comments
 (0)