Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cdc maybe stuck when send SIGSTOP to pd leader #7470

Closed
zeminzhou opened this issue Oct 28, 2022 · 2 comments · Fixed by #7472 or #7519
Closed

cdc maybe stuck when send SIGSTOP to pd leader #7470

zeminzhou opened this issue Oct 28, 2022 · 2 comments · Fixed by #7472 or #7519
Assignees
Labels
affects-6.4 area/ticdc Issues or PRs related to TiCDC. severity/major type/bug The issue is confirmed as a bug.

Comments

@zeminzhou
Copy link
Contributor

What did you do?

  1. tiup start one cluster with two cdc & three cdc
  2. kill -19 to pd leader
  3. cdc cli capture list can't list all capture, if cdc cli capture list sucessfully, repeat step 2.

What did you expect to see?

cdc cli capture list list all capture

What did you see instead?

cdc cli capture list can't list all capture

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

v6.3.0

Upstream TiKV version (execute tikv-server --version):

v6.3.0 

TiCDC version (execute cdc version):

v6.3.0
@zeminzhou zeminzhou added area/ticdc Issues or PRs related to TiCDC. type/bug The issue is confirmed as a bug. labels Oct 28, 2022
@zeminzhou
Copy link
Contributor Author

zeminzhou commented Oct 28, 2022

From debug, capture routine may exit when kill -19 to pd leader, and capture routine will recover by itself. Then capture routine will call reset, reset will call concurrency.NewSession, capture routine stuck here.
image

@zeminzhou
Copy link
Contributor Author

When kill -19 to pd leader, capture(that is not pd leader )'s processor routine will exit and the owner routine will struck(even if cancel is called). From debug, owner routine will stuck here.
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-6.4 area/ticdc Issues or PRs related to TiCDC. severity/major type/bug The issue is confirmed as a bug.
Projects
None yet
5 participants