Skip to content

[feature] Add new tables to an existing Flink CDC job #513

Closed
@wuchong

Description

Sometimes, a Flink CDC job may only read [t1, t3, t5], but after some days we would like the job can also read [t4, t6] but don't want to lose the savepoint of the job. For example, update the table-name value of the job to include t4 and t6 and restore the job from previous savepoint.

This is a feature like Debezium's snapshot.new.tables feature. But it's not an easy work for Flink CDC to integerate it. Because since v2.0, we refatored the mysql-cdc to support parallel reading which only uses some internal readers of Debezium instead of a whole Debezium engine. So the snapshot.new.tables option can't transparently supported.

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions