Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: Make write buffer memory check do until safe #32172

Merged
merged 1 commit into from
Apr 12, 2024

Conversation

congqixia
Copy link
Contributor

See also #27675 #26177

Make memory check evict memory buffer until memory water level is safe. Also make EvictBuffer wait until sync task done.

@sre-ci-robot sre-ci-robot added approved size/M Denotes a PR that changes 30-99 lines. labels Apr 11, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement labels Apr 11, 2024
Copy link
Contributor

mergify bot commented Apr 11, 2024

@congqixia ut workflow job failed, comment rerun ut can trigger the job again.

See also milvus-io#27675 milvus-io#26177

Make memory check evict memory buffer until memory water level is safe.
Also make `EvictBuffer` wait until sync task done.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
@congqixia congqixia force-pushed the enhance/evict_until_safe branch from a5afa91 to 7077862 Compare April 11, 2024 12:35
Copy link

codecov bot commented Apr 11, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 81.70%. Comparing base (371e6d2) to head (7077862).
Report is 3 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #32172      +/-   ##
==========================================
- Coverage   81.75%   81.70%   -0.05%     
==========================================
  Files         991      991              
  Lines      122131   122134       +3     
==========================================
- Hits        99853    99795      -58     
- Misses      18452    18512      +60     
- Partials     3826     3827       +1     
Files Coverage Δ
internal/datanode/writebuffer/manager.go 92.48% <100.00%> (+1.57%) ⬆️
internal/datanode/writebuffer/write_buffer.go 91.47% <100.00%> (-0.55%) ⬇️

... and 34 files with indirect coverage changes

@mergify mergify bot added the ci-passed label Apr 11, 2024
@XuanYang-cn
Copy link
Contributor

/lgtm
/approve

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot sre-ci-robot merged commit c0fa169 into milvus-io:master Apr 12, 2024
15 checks passed
congqixia added a commit to congqixia/milvus that referenced this pull request Apr 12, 2024
See also milvus-io#27675 milvus-io#26177

Make memory check evict memory buffer until memory water level is safe.
Also make `EvictBuffer` wait until sync task done.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Apr 12, 2024
…32172) (#32201)

Cherry-pick from master
pr: #32172
See also #27675 #26177

Make memory check evict memory buffer until memory water level is safe.
Also make `EvictBuffer` wait until sync task done.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm size/M Denotes a PR that changes 30-99 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants