enhance: Enable to write multiple segments in mix compactor

[XuanYang-cn]

Prevent segments to be written larger than maxSize * expansionRate

See also: #35584

Signed-off-by: yangxuan xuan.yang@zilliz.com

[codecov]

Codecov Report

Attention: Patch coverage is 78.87324% with 60 lines in your changes missing coverage. Please review.

Project coverage is 72.28%. Comparing base (56b3490) to head (3f06087).
Report is 27 commits behind head on master.

Files with missing lines	Patch %	Lines
internal/datanode/compaction/segment_writer.go	68.93%	21 Missing and 11 partials ⚠️
internal/datanode/compaction/mix_compactor.go	83.56%	10 Missing and 2 partials ⚠️
internal/datacoord/compaction_trigger.go	71.79%	9 Missing and 2 partials ⚠️
internal/datacoord/meta.go	93.75%	1 Missing and 2 partials ⚠️
internal/datacoord/compaction_task_mix.go	85.71%	0 Missing and 1 partial ⚠️
internal/datacoord/compaction_trigger_v2.go	83.33%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #35705      +/-   ##
==========================================
- Coverage   81.32%   72.28%   -9.04%     
==========================================
  Files        1238     1238              
  Lines      148082   148116      +34     
==========================================
- Hits       120425   107063   -13362     
- Misses      22887    36270   +13383     
- Partials     4770     4783      +13     

Files with missing lines	Coverage Δ
...ternal/datanode/compaction/clustering_compactor.go	67.45% <100.00%> (ø)
internal/datanode/compaction/compactor_common.go	88.80% <100.00%> (+0.46%)	⬆️
internal/datacoord/compaction_task_mix.go	63.40% <85.71%> (+0.31%)	⬆️
internal/datacoord/compaction_trigger_v2.go	72.65% <83.33%> (-0.83%)	⬇️
internal/datacoord/meta.go	89.89% <93.75%> (+0.05%)	⬆️
internal/datacoord/compaction_trigger.go	84.93% <71.79%> (-2.35%)	⬇️
internal/datanode/compaction/mix_compactor.go	77.12% <83.56%> (+6.48%)	⬆️
internal/datanode/compaction/segment_writer.go	76.03% <68.93%> (-8.52%)	⬇️

... and 230 files with indirect coverage changes

[bigsheeper]

/lgtm

[XuanYang-cn]

rerun ut

[XuanYang-cn]

/run-cpu-e2e

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[wayblink]

/lgtm

[congqixia]

/approve

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• internal/datacoord/OWNERS [congqixia]
• internal/datanode/OWNERS [congqixia]
• internal/proto/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment