Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[typo](docs) Fix some ambiguous descriptions #23912

Merged
merged 7 commits into from
Oct 16, 2023
Merged

[typo](docs) Fix some ambiguous descriptions #23912

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
5b1fea0
[typo](docs) Fix some ambiguous descriptions
yagagagaga Sep 5, 2023
be89f2c
update files
yagagagaga Sep 5, 2023
f1a124a
Merge branch 'master' into doc_20230905_2
yagagagaga Sep 5, 2023
03f5d25
Merge branch 'master' into doc_20230905_2
yagagagaga Sep 7, 2023
a4c850c
Merge branch 'master' into doc_20230905_2
yagagagaga Sep 11, 2023
b806276
Merge branch 'master' into doc_20230905_2
yagagagaga Sep 23, 2023
1777b91
Merge branch 'master' into doc_20230905_2
yagagagaga Oct 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Next Next commit
[typo](docs) Fix some ambiguous descriptions
  • Loading branch information
@yagagagaga
yagagagaga committed Sep 5, 2023
commit 5b1fea0236bb2ccc8aa39614618591ac584f2f9a
6 changes: 4 additions & 2 deletions docs/en/docs/data-operate/import/import-way/broker-load-manual.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -351,7 +351,8 @@ Only the case of a single BE is discussed here. If the user cluster has multiple

For example, for a 100G file, the number of BEs in the cluster is 10
max_broker_concurrency = 10
max_bytes_per_broker_scanner >= 10G = 100G / 10
# >= the amount of data processed by a single BE of the current import task
max_bytes_per_broker_scanner = 1069547520
````

After modification, all BEs will process the import task concurrently, each BE processing part of the original file.
Expand All @@ -364,7 +365,8 @@ Only the case of a single BE is discussed here. If the user cluster has multiple
The amount of data processed by a single BE of the current import task / the slowest import speed of the user Doris cluster (MB/s) >= the timeout time of the current import task >= the amount of data processed by a single BE of the current import task / 10M/s

For example, for a 100G file, the number of BEs in the cluster is 10
timeout >= 1000s = 10G / 10M/s
# >= 1000s = 10G / 10M/s
timeout = 1000
````

3. When the user finds that the timeout time calculated in the second step exceeds the default import timeout time of 4 hours
Expand Down
4 changes: 2 additions & 2 deletions docs/zh-CN/docs/admin-manual/config/fe-config.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1161,7 +1161,7 @@ current running txns on db xxx is xx, larger than limit xx

#### `max_bytes_per_broker_scanner`

默认值：500 * 1024 * 1024 * 1024L （500G）
默认值：`500 * 1024 * 1024 * 1024L` （500G）

是否可以动态配置：true

Expand Down Expand Up @@ -2769,4 +2769,4 @@ show data （其他用法：HELP SHOW DATA）

默认值：true

暂时性配置项，开启后会启动后台线程自动将所有的olap表修改为可light schema change，修改结果可通过命令`show convert_light_schema_change [from db]` 来查看，将会展示所有非light schema change表的转换结果
暂时性配置项，开启后会启动后台线程自动将所有的olap表修改为可light schema change，修改结果可通过命令`show convert_light_schema_change [from db]` 来查看，将会展示所有非light schema change表的转换结果
6 changes: 4 additions & 2 deletions docs/zh-CN/docs/data-operate/import/import-way/broker-load-manual.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -351,7 +351,8 @@ Broker Load 需要借助 Broker 进程访问远端存储，不同的 Broker 需

比如一个 100G 的文件，集群的 BE 个数为 10 个
max_broker_concurrency = 10
max_bytes_per_broker_scanner >= 10G = 100G / 10
# >= 10G = 100G / 10
max_bytes_per_broker_scanner = 1069547520
```

修改后，所有的 BE 会并发的处理导入任务，每个 BE 处理原始文件的一部分。
Expand All @@ -364,7 +365,8 @@ Broker Load 需要借助 Broker 进程访问远端存储，不同的 Broker 需
当前导入任务单个 BE 处理的数据量 / 用户 Doris 集群最慢导入速度(MB/s) >= 当前导入任务的 timeout 时间 >= 当前导入任务单个 BE 处理的数据量 / 10M/s

比如一个 100G 的文件，集群的 BE 个数为 10个
timeout >= 1000s = 10G / 10M/s
# >= 1000s = 10G / 10M/s
timeout = 1000
```

3. 当用户发现第二步计算出的 timeout 时间超过系统默认的导入最大超时时间 4小时
Expand Down