Added support for multiple databases - MySQL

[subkanthi]

Debezium connectors supports multiple databases use this configuration variable
"database.include.list", where a list of databases can be provided.

But currently Sink connector only supports writing the results to a single database.

clickhouse.server.database: "test"

This issue is to add support for multiple databases so we could replicate multiple MySQL databases to multiple CH databases using one sink connector process.

[TruongNT95]

I got the same problem with kafka sink connector. I have 700+ databases, each database has 20+ tables stored in kafka topic follow structure :
db1.table1, db1.table2,db1.table3....
db2.table1, db2.table2,db2.table3....
db3.table1, db3.table2, db3.table3....
....
I am looking for a solution to map all databases to Clickhouse with only one connector. Do you have any solution for this problem? Something to solve like "topics.regex" of Debezium

[subkanthi]

I got the same problem with kafka sink connector. I have 700+ databases, each database has 20+ tables stored in kafka topic follow structure : db1.table1, db1.table2,db1.table3.... db2.table1, db2.table2,db2.table3.... db3.table1, db3.table2, db3.table3.... .... I am looking for a solution to map all databases to Clickhouse with only one connector. Do you have any solution for this problem? Something to solve like "topics.regex" of Debezium

Hi @TruongNT95 , currently the limitation is we only support one ClickHouse destination database. We are working on this feature first for the lightweight version, we will work on Kafka support after that.