-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Description
Thanks for the CDC Dataflow template. I ran the template and faced a couple of issues. If they are valid, I'd be happy to submit a PR.
-
In the properties file,
databaseNameshould actually be namedinstanceNamesince it is used as Debezium'sdatabase.server.nameproperty. -
Discrepancy in PubSub Topic name. The Deploying the connector section states:
A prefix for PubSub topics corresponding to each MySQL table. The connector will push table updates to ${PREFIX}${DB_INSTANCE}.${DATABASE}.${TABLE}
i.e. the topic name is dot separated. Whereas later Setting up PubSub topics section states it is underscore separated.
Table: my-mysql.cdc_demo.people
Topic: export_demo_my-mysql_cdc_demo_peopleIt happens to be dot separated actually as per the logic in PubSubChangeConsumer.getPubsubTopicName since table name already is dot separated and there's no
String.replacebeing done there to create the topic name underscore separated. So the docs in latter section needs a change. -
Order of dataset arguments passed to
MergeStatementBuildingFnin BigQueryChangeApplier is incorrect.MergeStatementBuildingFnexpectschangeLogDatasetfirst.