Skip to content

Commit f717689

Browse files
committed
update doc about mlsql ps service
1 parent c99bacc commit f717689

3 files changed

Lines changed: 11 additions & 37 deletions

File tree

docs/gitbook/en/guide/python/distribute-python.md

Lines changed: 4 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -21,26 +21,18 @@ will upload the result to HDFS automatically.
2121
If you runs on yarn mode, please make sure you start the MLSQL Engine with follow configuration:
2222

2323
```
24+
2425
-streaming.ps.cluster.enable should be enabled.
2526
2627
Please make sure
27-
you have the uber-jar of mlsql placed in
28-
1. --jars
29-
2. --conf "spark.executor.extraClassPath=[your jar name in jars]"
30-
31-
for exmaple:
28+
1. you have the uber-jar of mlsql placed in --jars
29+
2. Put mlsql-ps-service_xxx_2.11-xxx.jar to $SPARK_HOME/libs
3230
33-
--jars ./streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar
34-
--conf "spark.executor.extraClassPath=streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar"
31+
More detail about [mlsql-ps-service](https://github.com/allwefantasy/mlsql-ps-service)
3532
3633
Otherwise the executor will
3734
fail to start and the whole application will fails.
38-
```
3935
40-
If you runs on Standalone, please send the MLSQL jar to every node and then configure:
41-
42-
```
43-
--conf "spark.executor.extraClassPath=[MLSQL jar path]"
4436
```
4537

4638
## Steps

docs/gitbook/zh/python/distribute-python.md

Lines changed: 3 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -20,14 +20,10 @@
2020
-streaming.ps.cluster.enable should be enabled.
2121
2222
Please make sure
23-
you have the uber-jar of mlsql placed in
24-
1. --jars
25-
2. --conf "spark.executor.extraClassPath=[your jar name in jars]"
23+
1. you have the uber-jar of mlsql placed in --jars
24+
2. Put mlsql-ps-service_xxx_2.11-xxx.jar to $SPARK_HOME/libs
2625
27-
for exmaple:
28-
29-
--jars ./streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar
30-
--conf "spark.executor.extraClassPath=streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar"
26+
More detail about [mlsql-ps-service](https://github.com/allwefantasy/mlsql-ps-service)
3127
3228
Otherwise the executor will
3329
fail to start and the whole application will fails.
@@ -36,11 +32,7 @@ fail to start and the whole application will fails.
3632

3733
否则会出现不可预料错误。
3834

39-
如果你是在Standalone模式下使用,请将MLSQL Uber Jar 发送到各个节点上,然后配置
4035

41-
```
42-
--conf "spark.executor.extraClassPath=[MLSQL jar包完整路径]"
43-
```
4436

4537
## 使用步骤
4638

docs/gitbook/zh/python/python.md

Lines changed: 4 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -13,28 +13,18 @@
1313
-streaming.ps.cluster.enable should be enabled.
1414
1515
Please make sure
16-
you have the uber-jar of mlsql placed in
17-
1. --jars
18-
2. --conf "spark.executor.extraClassPath=[your jar name in jars]"
16+
1. you have the uber-jar of mlsql placed in --jars
17+
2. Put mlsql-ps-service_xxx_2.11-xxx.jar to $SPARK_HOME/libs
1918
20-
for exmaple:
19+
More detail about [mlsql-ps-service](https://github.com/allwefantasy/mlsql-ps-service)
2120
22-
--jars ./streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar
23-
--conf "spark.executor.extraClassPath=streamingpro-mlsql-spark_2.x-x.x.x-SNAPSHOT.jar"
24-
25-
Otherwise the executor wil
26-
l
21+
Otherwise the executor will
2722
fail to start and the whole application will fails.
2823
2924
```
3025

3126
否则会出现不可预料错误。
3227

33-
如果你是在Standalone模式下使用,请将MLSQL Uber Jar 发送到各个节点上,然后配置
34-
35-
```
36-
--conf "spark.executor.extraClassPath=[MLSQL jar包完整路径]"
37-
```
3828

3929
## 案例场景
4030

0 commit comments

Comments
 (0)