Skip to content

Commit

Permalink
Revert "[scan](improvement) Adjust parallel scanners num (apache#38430)…
Browse files Browse the repository at this point in the history
…" (apache#39046)

This reverts commit 11b332f.
  • Loading branch information
HappenLee authored Aug 7, 2024
1 parent 4f08995 commit 99dce14
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions be/src/pipeline/exec/scan_operator.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -1222,8 +1222,9 @@ Status ScanLocalState<Derived>::_start_scanners(
state(), this, p._output_tuple_desc, p.output_row_descriptor(), scanners, p.limit(),
state()->scan_queue_mem_limit(), _scan_dependency,
// 1. If data distribution is ignored , we use 1 instance to scan.
// 2. Else, file scanner will consume much memory so we use config::doris_scanner_thread_pool_thread_num / query_parallel_instance_num scanners to scan.
p.ignore_data_distribution() && !p.is_file_scan_operator()
// 2. Else if this operator is not file scan operator, we use config::doris_scanner_thread_pool_thread_num scanners to scan.
// 3. Else, file scanner will consume much memory so we use config::doris_scanner_thread_pool_thread_num / query_parallel_instance_num scanners to scan.
p.ignore_data_distribution() || !p.is_file_scan_operator()
? 1
: state()->query_parallel_instance_num());
return Status::OK();
Expand Down

0 comments on commit 99dce14

Please sign in to comment.