Skip to content

Commit

Permalink
Merge pull request #614 from Altinity/remove_clickhouse_server_database
Browse files Browse the repository at this point in the history 
Remove clickhouse server database
  • Loading branch information
@subkanthi
subkanthi authored Jun 20, 2024
2 parents de52513 + 391c35f commit 08b5db1
Show file tree
Hide file tree
Showing 35 changed files with 17 additions and 90 deletions.
2 changes: 0 additions & 2 deletions doc/OLD_README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,6 @@ GLOBAL OPTIONS:
| clickhouse.server.user | ClickHouse username |
| clickhouse.server.password | ClickHouse password |
| clickhouse.server.port | ClickHouse port, For TLS(use the correct port `8443` or `443` |
| clickhouse.server.database | ClickHouse destination database |
| snapshot.mode | "initial" -> Data that already exists in source database will be replicated. "schema_only" -> Replicate data that is added/modified after the connector is started.\<br/> MySQL: https://debezium.io/documentation/reference/stable/connectors/mysql.html#mysql-property-snapshot-mode \ <br/>PostgreSQL: https://debezium.io/documentation/reference/stable/connectors/postgresql.html#postgresql-property-snapshot-mode <br/> MongoDB: initial, never. https://debezium.io/documentation/reference/stable/connectors/mongodb.html |
| connector.class | MySQL -> "io.debezium.connector.mysql.MySqlConnector" <br/> PostgreSQL -> <br/> Mongo -> <br/> |
| offset.storage.file.filename | Offset storage file(This stores the offsets of the source database) MySQL: mysql binlog file and position, gtid set. Make sure this file is durable and its not persisted in temp directories. |
Expand Down Expand Up @@ -298,7 +297,6 @@ mvn install -DskipTests=true
| clickhouse.server.url | | ClickHouse Server URL |
| clickhouse.server.user | | ClickHouse Server username |
| clickhouse.server.password | | ClickHouse Server password |
| clickhouse.server.database | | ClickHouse Database name |
| clickhouse.server.port | 8123 | ClickHouse Server port |
| clickhouse.topic2table.map | No | Map of Kafka topics to table names, <topic_name1>:<table_name1>,<topic_name2>:<table_name2> This variable will override the default mapping of topics to table names. |
| store.kafka.metadata | false | If set to true, kafka metadata columns will be added to Clickhouse |
Expand Down
1 change: 0 additions & 1 deletion doc/configuration.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,6 @@
| clickhouse.server.user | ClickHouse username |
| clickhouse.server.password | ClickHouse password |
| clickhouse.server.port | ClickHouse port, For TLS(use the correct port `8443` or `443` |
| clickhouse.server.database | ClickHouse destination database |
| snapshot.mode | "initial" -> Data that already exists in source database will be replicated. "schema_only" -> Replicate data that is added/modified after the connector is started.\<br/> MySQL: https://debezium.io/documentation/reference/stable/connectors/mysql.html#mysql-property-snapshot-mode \ <br/>PostgreSQL: https://debezium.io/documentation/reference/stable/connectors/postgresql.html#postgresql-property-snapshot-mode <br/> MongoDB: initial, never. https://debezium.io/documentation/reference/stable/connectors/mongodb.html |
| connector.class | MySQL -> "io.debezium.connector.mysql.MySqlConnector" <br/> PostgreSQL -> <br/> Mongo -> <br/> |
| offset.storage.file.filename | Offset storage file(This stores the offsets of the source database) MySQL: mysql binlog file and position, gtid set. Make sure this file is durable and its not persisted in temp directories. |
Expand Down
1 change: 0 additions & 1 deletion doc/configuration_kafka.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@ for both **Debezium** and **Sink**
| clickhouse.server.url | | ClickHouse Server URL |
| clickhouse.server.user | | ClickHouse Server username |
| clickhouse.server.password | | ClickHouse Server password |
| clickhouse.server.database | | ClickHouse Database name |
| clickhouse.server.port | 8123 | ClickHouse Server port |
| clickhouse.topic2table.map | No | Map of Kafka topics to table names, <topic_name1>:<table_name1>,<topic_name2>:<table_name2> This variable will override the default mapping of topics to table names. |
| store.kafka.metadata | false | If set to true, kafka metadata columns will be added to Clickhouse |
Expand Down
1 change: 0 additions & 1 deletion doc/sink_configuration.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,6 @@ This is a sample configuration that's used in creating the connector using the K
"clickhouse.server.url": "${CLICKHOUSE_HOST}",
"clickhouse.server.user": "${CLICKHOUSE_USER}",
"clickhouse.server.password": "${CLICKHOUSE_PASSWORD}",
"clickhouse.server.database": "${CLICKHOUSE_DATABASE}",
"clickhouse.server.port": ${CLICKHOUSE_PORT},
"clickhouse.table.name": "${CLICKHOUSE_TABLE}",
"key.converter": "io.apicurio.registry.utils.converter.AvroConverter",
Expand Down
2 changes: 1 addition & 1 deletion pom.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
<maven.compiler.target>17</maven.compiler.target>
<project.reporting.outputEncoding>UTF-8</project.reporting.outputEncoding>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
<version.debezium>2.4.0</version.debezium>
<version.debezium>2.5.0.Beta1</version.debezium>
<version.junit>5.9.1</version.junit>
<version.checkstyle.plugin>3.1.1</version.checkstyle.plugin>
<project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
Expand Down
1 change: 0 additions & 1 deletion sink-connector-lightweight/config.examples/mysql_config.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,6 @@ clickhouse.server.url: "localhost"
clickhouse.server.user: "root"
clickhouse.server.password: "root"
clickhouse.server.port: "8123"
clickhouse.server.database: "test"
database.allowPublicKeyRetrieval: "true"
snapshot.mode: "schema_only"
connector.class: "io.debezium.connector.mysql.MySqlConnector"
Expand Down
3 changes: 0 additions & 3 deletions sink-connector-lightweight/docker/config.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -41,9 +41,6 @@ clickhouse.server.password: "root"
# Clickhouse Server Port
clickhouse.server.port: "8123"

# Clickhouse Server Database
clickhouse.server.database: "test"

# database.allowPublicKeyRetrieval: "true" https://rmoff.net/2019/10/23/debezium-mysql-v8-public-key-retrieval-is-not-allowed/
database.allowPublicKeyRetrieval: "true"

Expand Down
3 changes: 0 additions & 3 deletions sink-connector-lightweight/docker/config_local.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,6 @@ clickhouse.server.password: "root"
# Clickhouse Server Port
clickhouse.server.port: "8123"

# Clickhouse Server Database
clickhouse.server.database: "test"

# database.allowPublicKeyRetrieval: "true" https://rmoff.net/2019/10/23/debezium-mysql-v8-public-key-retrieval-is-not-allowed/
database.allowPublicKeyRetrieval: "true"

Expand Down
3 changes: 0 additions & 3 deletions sink-connector-lightweight/docker/config_postgres.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -43,9 +43,6 @@ clickhouse.server.password: "root"
# clickhouse.server.port: Clickhouse Server Port
clickhouse.server.port: "8123"

# clickhouse.server.database: Clickhouse Server Database
clickhouse.server.database: "test"

# database.allowPublicKeyRetrieval: "true" https://rmoff.net/2019/10/23/debezium-mysql-v8-public-key-retrieval-is-not-allowed/
database.allowPublicKeyRetrieval: "true"

Expand Down
2 changes: 0 additions & 2 deletions sink-connector-lightweight/helm/sink-connector-lightweight/templates/configmap.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,6 @@ data:
clickhouse.server.user: "root"
clickhouse.server.password: "root"
clickhouse.server.port: "8123"
clickhouse.server.database: "test"
database.allowPublicKeyRetrieval: "true"
snapshot.mode: "initial"
offset.flush.interval.ms: 5000
Expand Down Expand Up @@ -71,7 +70,6 @@ data:
clickhouse.server.user: "root"
clickhouse.server.pass: "secretsecret"
clickhouse.server.port: "8123"
clickhouse.server.database: "default"
database.allowPublicKeyRetrieval: "true"
snapshot.mode: "initial"
offset.flush.interval.ms: "5000"
Expand Down
Loading

0 comments on commit 08b5db1

Please sign in to comment.