Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sorter: Stabilize Unified Sorter #1210

Merged
merged 46 commits into from
Dec 24, 2020

Conversation

liuzix
Copy link
Contributor

@liuzix liuzix commented Dec 15, 2020

What problem does this PR solve?

  • Lack of mechanism to reduce the use of Goroutines in Unified Sorter.

What is changed and how it works?

  • WorkerPool is implemented to provide a mechanism in which one Goroutine can process events from multiple sources.

Check List

Tests

  • Unit test

Code changes

  • Has exported function/method change
  • Has interface methods change

Side effects

  • Increased code complexity

Related changes

  • Need to cherry-pick to the release branch

Release note

  • Enable Unified Sorter by default.

@liuzix liuzix added status/WIP status/ptal Could you please take a look? component/puller Puller component. labels Dec 15, 2020
@liuzix liuzix removed the status/WIP label Dec 16, 2020
@liuzix liuzix changed the title sorter: Stabilizing Unified Sorter Part I: WorkerPool sorter: Stabilize Unified Sorter Dec 16, 2020
@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

1 similar comment
@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

1 similar comment
@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 16, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 23, 2020

/run-all-tests

Copy link
Contributor

@amyangfei amyangfei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-srebot ti-srebot removed the status/LGT1 Indicates that a PR has LGTM 1. label Dec 23, 2020
@ti-srebot ti-srebot added the status/LGT2 Indicates that a PR has LGTM 2. label Dec 23, 2020
@@ -16,6 +16,7 @@ export AWS_SECRET_ACCESS_KEY=$MINIO_SECRET_KEY
export S3_ENDPOINT=127.0.0.1:24927
rm -rf "$WORK_DIR"
mkdir -p "$WORK_DIR"
pkill -9 minio
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
pkill -9 minio
pkill -9 minio || true

@liuzix
Copy link
Contributor Author

liuzix commented Dec 23, 2020

/run-all-tests

1 similar comment
@liuzix
Copy link
Contributor Author

liuzix commented Dec 23, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 23, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 23, 2020

/run-all-tests

@liuzix
Copy link
Contributor Author

liuzix commented Dec 23, 2020

/run-all-tests

@zier-one
Copy link
Contributor

/merge

@ti-srebot ti-srebot added the status/can-merge Indicates a PR has been approved by a committer. label Dec 24, 2020
@ti-srebot
Copy link
Contributor

/run-all-tests

@ti-srebot ti-srebot merged commit a3fb52e into pingcap:master Dec 24, 2020
ti-srebot pushed a commit to ti-srebot/ticdc that referenced this pull request Dec 24, 2020
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-srebot
Copy link
Contributor

cherry pick to release-4.0 in PR #1230

ti-srebot pushed a commit to ti-srebot/ticdc that referenced this pull request Dec 24, 2020
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-srebot
Copy link
Contributor

cherry pick to release-5.0-rc in PR #1231

ti-srebot added a commit that referenced this pull request Dec 24, 2020
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
ti-srebot added a commit that referenced this pull request Jan 6, 2021
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/puller Puller component. needs-cherry-pick-release-4.0 Should cherry pick this PR to release-4.0 branch. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2. status/ptal Could you please take a look?
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants