To refactor KafkaSink to use more workers for message production. #11019
Labels
area/ticdc
Issues or PRs related to TiCDC.
component/sink
Sink component.
type/enhancement
The issue or PR belongs to an enhancement.
Is your feature request related to a problem?
To ensure all data from a table are sent sequentially downstream to Kafka, the KafkaSink uses only one worker to produce messages of a changefeed (in a processor).
This means that only one TCP connection is established between CDC and the Kafka server. Therefore, in case of high network latency, the throughput of KafkaSink can significantly deteriorate. (See #10775)
Describe the feature you'd like
Describe alternatives you've considered
No response
Teachability, Documentation, Adoption, Migration Strategy
No response
The text was updated successfully, but these errors were encountered: