Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: [Cherry-pick] cache collection schema attributes to reduce proxy cpu (#29668) #29692

Merged
merged 1 commit into from
Jan 7, 2024

Conversation

congqixia
Copy link
Contributor

Cherry-pick from master
pr: #29668

See also #29113

The collection schema is crucial when performing search/query but some of the information is calculated for every request.

This PR change schema field of cached collection info into a utility schemaInfo type to store some stable result, say pk field, partitionKeyEnabled, etc. And provided field name to id map for search/query services.


…us-io#29668)

See also milvus-io#29113

The collection schema is crucial when performing search/query but some
of the information is calculated for every request.

This PR change schema field of cached collection info into a utility
`schemaInfo` type to store some stable result, say pk field,
partitionKeyEnabled, etc. And provided field name to id map for
search/query services.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
@sre-ci-robot sre-ci-robot added approved size/L Denotes a PR that changes 100-499 lines. labels Jan 4, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement labels Jan 4, 2024
Copy link
Contributor

mergify bot commented Jan 4, 2024

@congqixia E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

@congqixia
Copy link
Contributor Author

/run-cpu-e2e

Copy link

codecov bot commented Jan 4, 2024

Codecov Report

Attention: 6 lines in your changes are missing coverage. Please review.

Comparison is base (cf228c2) 82.13% compared to head (628e32d) 82.14%.
Report is 9 commits behind head on 2.3.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##              2.3   #29692   +/-   ##
=======================================
  Coverage   82.13%   82.14%           
=======================================
  Files         833      833           
  Lines      119771   119794   +23     
=======================================
+ Hits        98377    98407   +30     
+ Misses      18163    18162    -1     
+ Partials     3231     3225    -6     
Files Coverage Δ
internal/proxy/meta_cache.go 89.64% <100.00%> (+0.40%) ⬆️
internal/proxy/task.go 85.68% <100.00%> (ø)
internal/proxy/task_delete.go 85.98% <100.00%> (ø)
internal/proxy/task_index.go 77.54% <100.00%> (ø)
internal/proxy/task_query.go 80.30% <100.00%> (ø)
internal/proxy/util.go 90.94% <100.00%> (-0.26%) ⬇️
...nternal/distributed/proxy/httpserver/handler_v1.go 91.27% <0.00%> (ø)
internal/proxy/task_insert.go 69.19% <66.66%> (ø)
internal/proxy/task_search.go 77.35% <75.00%> (-0.13%) ⬇️
internal/proxy/task_upsert.go 70.37% <66.66%> (ø)

... and 12 files with indirect coverage changes

@mergify mergify bot added the ci-passed label Jan 4, 2024
@xiaofan-luan
Copy link
Collaborator

/lgtm
/approve

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, xiaofan-luan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot sre-ci-robot merged commit 0c83440 into milvus-io:2.3 Jan 7, 2024
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm size/L Denotes a PR that changes 100-499 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants