File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -21,26 +21,18 @@ will upload the result to HDFS automatically.
2121If you runs on yarn mode, please make sure you start the MLSQL Engine with follow configuration:
2222
2323```
24+
2425-streaming.ps.cluster.enable should be enabled.
2526
2627Please make sure
27- you have the uber-jar of mlsql placed in
28- 1. --jars
29- 2. --conf "spark.executor.extraClassPath=[your jar name in jars]"
30-
31- for exmaple:
28+ 1. you have the uber-jar of mlsql placed in --jars
29+ 2. Put mlsql-ps-service_xxx_2.11-xxx.jar to $SPARK_HOME/libs
3230
33- --jars ./streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar
34- --conf "spark.executor.extraClassPath=streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar"
31+ More detail about [mlsql-ps-service](https://github.com/allwefantasy/mlsql-ps-service)
3532
3633Otherwise the executor will
3734fail to start and the whole application will fails.
38- ```
3935
40- If you runs on Standalone, please send the MLSQL jar to every node and then configure:
41-
42- ```
43- --conf "spark.executor.extraClassPath=[MLSQL jar path]"
4436```
4537
4638## Steps
Original file line number Diff line number Diff line change 2020-streaming.ps.cluster.enable should be enabled.
2121
2222Please make sure
23- you have the uber-jar of mlsql placed in
24- 1. --jars
25- 2. --conf "spark.executor.extraClassPath=[your jar name in jars]"
23+ 1. you have the uber-jar of mlsql placed in --jars
24+ 2. Put mlsql-ps-service_xxx_2.11-xxx.jar to $SPARK_HOME/libs
2625
27- for exmaple:
28-
29- --jars ./streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar
30- --conf "spark.executor.extraClassPath=streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar"
26+ More detail about [mlsql-ps-service](https://github.com/allwefantasy/mlsql-ps-service)
3127
3228Otherwise the executor will
3329fail to start and the whole application will fails.
@@ -36,11 +32,7 @@ fail to start and the whole application will fails.
3632
3733否则会出现不可预料错误。
3834
39- 如果你是在Standalone模式下使用,请将MLSQL Uber Jar 发送到各个节点上,然后配置
4035
41- ```
42- --conf "spark.executor.extraClassPath=[MLSQL jar包完整路径]"
43- ```
4436
4537## 使用步骤
4638
Original file line number Diff line number Diff line change 1313-streaming.ps.cluster.enable should be enabled.
1414
1515Please make sure
16- you have the uber-jar of mlsql placed in
17- 1. --jars
18- 2. --conf "spark.executor.extraClassPath=[your jar name in jars]"
16+ 1. you have the uber-jar of mlsql placed in --jars
17+ 2. Put mlsql-ps-service_xxx_2.11-xxx.jar to $SPARK_HOME/libs
1918
20- for exmaple:
19+ More detail about [mlsql-ps-service](https://github.com/allwefantasy/mlsql-ps-service)
2120
22- --jars ./streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar
23- --conf "spark.executor.extraClassPath=streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar"
24-
25- Otherwise the executor wil
26- l
21+ Otherwise the executor will
2722fail to start and the whole application will fails.
2823
2924```
3025
3126否则会出现不可预料错误。
3227
33- 如果你是在Standalone模式下使用,请将MLSQL Uber Jar 发送到各个节点上,然后配置
34-
35- ```
36- --conf "spark.executor.extraClassPath=[MLSQL jar包完整路径]"
37- ```
3828
3929## 案例场景
4030
You can’t perform that action at this time.
0 commit comments