Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement]: Optimize the performance of stats task #37373

Closed
1 task done
bigsheeper opened this issue Nov 1, 2024 · 0 comments
Closed
1 task done

[Enhancement]: Optimize the performance of stats task #37373

bigsheeper opened this issue Nov 1, 2024 · 0 comments
Assignees
@bigsheeper
Labels
kind/enhancement Issues or changes related to enhancement
Milestone
2.5.0

Comments

@bigsheeper
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

What would you like to be added?

Optimize the performance of stats task

Why is this needed?

No response

Anything else?

No response
@bigsheeper bigsheeper added the kind/enhancement Issues or changes related to enhancement label Nov 1, 2024
@bigsheeper bigsheeper added this to the 2.5.0 milestone Nov 1, 2024
@bigsheeper bigsheeper self-assigned this Nov 1, 2024
@bigsheeper bigsheeper mentioned this issue Nov 1, 2024
Merged
@xiaocai2333 xiaocai2333 mentioned this issue Nov 2, 2024
Open
1 task
sre-ci-robot pushed a commit that referenced this issue Nov 8, 2024
@bigsheeper
enhance: Optimize the performance of stats task (#37374)
8187942 
1. Increase the writer's `batchSize` to avoid multiple serialization
operations.
2. Perform asynchronous upload of binlog files to prevent blocking the
data processing flow.
3. Reduce multiple calls to `writer.Flush()`.

issue: #37373

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bigsheeper bigsheeper

Labels
kind/enhancement Issues or changes related to enhancement
Projects
None yet
Milestone
2.5.0
Development

No branches or pull requests
1 participant
@bigsheeper