Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

kafka dml sink can lost callbacks #9542

Closed
hicqu opened this issue Aug 10, 2023 · 0 comments · Fixed by #9527
Closed

kafka dml sink can lost callbacks #9542

hicqu opened this issue Aug 10, 2023 · 0 comments · Fixed by #9527
Assignees
@hicqu
Labels
affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. severity/moderate type/bug The issue is confirmed as a bug.

Comments

@hicqu
Copy link
Contributor

hicqu commented Aug 10, 2023 •
edited
Loading

What did you do?

  1. Create a changefeed with kafka sink.
  2. Inject some chaos to the kafka sink, for example, network partition.

Table sink callbacks can be lost. Then table progress can't be advanced any more.

What did you expect to see?

No response

What did you see instead?

TiCDC table progress is stuck.

Versions of the cluster

TiCDC 6.5, 7.1 and master branches have the problem.
@hicqu hicqu added type/bug The issue is confirmed as a bug. area/ticdc Issues or PRs related to TiCDC. labels Aug 10, 2023
@hicqu hicqu self-assigned this Aug 10, 2023
@hicqu hicqu mentioned this issue Aug 10, 2023
Merged
ti-chi-bot bot pushed a commit that referenced this issue Aug 11, 2023
@hicqu
sink(cdc): clean backends if table sink is stuck too long (#9527)
e99ba1a 
close #9542
This was referenced Aug 11, 2023
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Aug 14, 2023
@ti-chi-bot
sink(cdc): clean backends if table sink is stuck too long (#9527) (#9547
3b2151a 
)

close #9542
ti-chi-bot bot pushed a commit that referenced this issue Aug 15, 2023
@ti-chi-bot
sink(cdc): clean backends if table sink is stuck too long (#9527) (#9548
8622904 
)

close #9542
@nongfushanquan nongfushanquan mentioned this issue Aug 22, 2023
Merged
17 tasks
3AceShowHand pushed a commit to 3AceShowHand/tiflow that referenced this issue Aug 29, 2023
@hicqu @3AceShowHand
sink(cdc): clean backends if table sink is stuck too long (pingcap#9527)
98634c7 
close pingcap#9542
@nongfushanquan nongfushanquan mentioned this issue Sep 28, 2023
Merged
17 tasks
This was referenced Oct 10, 2023
Merged
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hicqu hicqu

Labels
affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

sink(cdc): clean backends if table sink is stuck too long hicqu/ticdc
1 participant
@hicqu