enhance: [2.5] Read metadata concurrently to accelerate recovery

[bigsheeper]

Read metadata such as segments, binlogs, and partitions concurrently at the collection level.

issue: #37630

pr: #38403

[codecov]

Codecov Report

Attention: Patch coverage is 89.25926% with 29 lines in your changes missing coverage. Please review.

Project coverage is 82.87%. Comparing base (4cb47b3) to head (c4c82f7).
Report is 5 commits behind head on 2.5.

Files with missing lines	Patch %	Lines
internal/datacoord/meta.go	86.76%	6 Missing and 3 partials ⚠️
internal/metastore/kv/querycoord/kv_catalog.go	80.64%	4 Missing and 2 partials ⚠️
internal/datacoord/server.go	58.33%	3 Missing and 2 partials ⚠️
internal/datacoord/broker/coordinator_broker.go	73.33%	3 Missing and 1 partial ⚠️
internal/metastore/kv/rootcoord/kv_catalog.go	85.18%	3 Missing and 1 partial ⚠️
internal/metastore/kv/datacoord/kv_catalog.go	94.73%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##              2.5   #38900      +/-   ##
==========================================
+ Coverage   81.04%   82.87%   +1.83%     
==========================================
  Files        1404     1104     -300     
  Lines      197402   170750   -26652     
==========================================
- Hits       159983   141510   -18473     
+ Misses      31799    23638    -8161     
+ Partials     5620     5602      -18     

Components	Coverage Δ
Client	78.26% <ø> (ø)
Core	∅ <ø> (∅)
Go	83.04% <89.25%> (+0.02%)	⬆️

Files with missing lines	Coverage Δ
internal/distributed/rootcoord/client/client.go	93.54% <100.00%> (+0.10%)	⬆️
internal/distributed/rootcoord/service.go	81.46% <100.00%> (+1.08%)	⬆️
internal/metastore/catalog.go	100.00% <ø> (ø)
internal/querycoordv2/meta/collection_manager.go	89.74% <100.00%> (+2.99%)	⬆️
internal/rootcoord/meta_table.go	83.35% <100.00%> (+0.05%)	⬆️
internal/rootcoord/root_coord.go	90.13% <100.00%> (+0.23%)	⬆️
internal/util/mock/grpc_rootcoord_client.go	86.04% <100.00%> (+0.21%)	⬆️
pkg/util/paramtable/service_param.go	99.15% <100.00%> (+<0.01%)	⬆️
internal/metastore/kv/datacoord/kv_catalog.go	77.44% <94.73%> (-1.26%)	⬇️
internal/datacoord/broker/coordinator_broker.go	96.22% <73.33%> (-3.78%)	⬇️
... and 4 more

... and 332 files with indirect coverage changes

[mergify]

@bigsheeper go-sdk check failed, comment rerun go-sdk can trigger the job again.

[bigsheeper]

rerun go-sdk

[mergify]

@bigsheeper go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@bigsheeper E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@bigsheeper go-sdk check failed, comment rerun go-sdk can trigger the job again.

[mergify]

@bigsheeper E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@bigsheeper go-sdk check failed, comment rerun go-sdk can trigger the job again.

[bigsheeper]

rerun go-sdk

[czs007]

/approve
/lgtm

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: bigsheeper, czs007

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [czs007]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[mergify]

@bigsheeper go-sdk check failed, comment rerun go-sdk can trigger the job again.

[bigsheeper]

rerun go-sdk