Merge pull request #18 from Altinity/develop

Release 1.0

README.md

@@ -3,8 +3,9 @@
 Sink connector sinks data from Kafka into Clickhouse.
 The connector is tested with the following converters
 - JsonConverter
-- AvroConverter (Using [Apicurio Schema Registry](https://www.apicur.io/registry/))
+- AvroConverter (Using [Apicurio Schema Registry](https://www.apicur.io/registry/) and Confluent Schema Registry)
 
+![](doc/img/sink_connector_mysql_architecture.jpg)
 # Features
 - Inserts, Updates and Deletes using ReplacingMergeTree/CollapsingMergeTree - [Updates/Deletes](doc/mutable_data.md)
 - Deduplication logic to dedupe records from Kafka topic.(Based on Primary Key)
@@ -17,6 +18,10 @@ The connector is tested with the following converters
 - Kafka Offset management in ClickHouse
 - Increased Parallelism(Customize thread pool for JDBC connections)
 
+
+
+### Grafana Dashboard
+![](doc/img/Grafana_dashboard.png) \
 # Source Databases
 - MySQL (Debezium)
 - PostgreSQL (Debezium) (Testing in progress)

deploy/config/grafana/README.md

@@ -0,0 +1,3 @@
+### Debezium Monitoring
+
+https://github.com/debezium/debezium-examples/tree/main/monitoring

deploy/config/grafana/dashboards/debezium/dashboard.yml

@@ -0,0 +1,10 @@
+apiVersion: 1
+providers:
+  - name: 'default'
+    orgId: 1
+    folder: ''
+    type: file
+    disableDeletion: false
+    updateIntervalSeconds: 10 #how often Grafana will scan for changed dashboards
+    options:
+      path: /var/lib/grafana/dashboards

deploy/config/grafana/dashboards/debezium/datasource.yml

@@ -0,0 +1,8 @@
+apiVersion: 1
+
+datasources:
+  - name: prometheus
+    type: prometheus
+    url: http://prometheus:9090
+    access: proxy
+    version: 1