Lightweight
Docker: altinity/clickhouse-sink-connector:2.4.0-lt
https://hub.docker.com/layers/altinity/clickhouse-sink-connector/2.4.0-lt/images/sha256-d509cafcadd11de0fd25b935efb0ee9e49429e9150ca9950c89d194e7a0b7f77?context=explore
Kafka
Docker: altinity/clickhouse-sink-connector:2.4.0-kafka
https://hub.docker.com/layers/altinity/clickhouse-sink-connector/2.4.0-kafka/images/sha256-21e31d08819c6af5c52c9cf80fefe6cba979d87da41a689c66f5cbed4f4b0e5a?context=explore
What's new:
ddl retry: When the ddl.retry: "true" variable is added to config.yml, if for some reason DDL's translated by sink connector fails to execute on ClickHouse, logic has been added to retry on an exponential backoff loop.
MySQL POINT & POLYGON data types: The Polygon and Point datatypes will be mapped to ClickHouse.
MySQL DDL Support: Added support for DROP CONSTRAINT and fixed bug with dropping NULL in ALTER TABLE.
sink-connector-client Added commands to purge schema history and offset table.
Exclude Generated/Alias and Materialized: Added logic to exclude Materialized and Alias columns.
What's Changed
- Update state_storage.md by @subkanthi in #771
- Update README.md to include state storage link by @subkanthi in #772
- Updated offset state storage documentation. by @subkanthi in #774
- Update state_storage.md to include schema storage. by @subkanthi in #775
- Update state_storage.md to include postgresql offsets by @subkanthi in #776
- Testflows new kafka tests by @Selfeer in #738
- Update quickstart.md to start sink connector service by @subkanthi in #785
- Added logic to get latest release from github by @subkanthi in #786
- Update quickstart.md with script to set environment variable. by @subkanthi in #787
- Update quickstart_postgres.md by @subkanthi in #788
- Added updates to script by @subkanthi in #789
- Added single.threaded flag to Mariadb test to validate replication in… by @subkanthi in #781
- Update production_setup.md by @subkanthi in #796
- Changed logging level to info for STRUCT EMPTY not a valid CDC record by @subkanthi in #795
- Update production_setup.md to include max_paritions_per_insert by @subkanthi in #804
- Added logic to commit batch in single threaded mode by @subkanthi in #802
- Update production_setup.md , fixed broken link by @subkanthi in #809
- Added support for DROP CONSTRAINT by @subkanthi in #807
- Update config.ym by @subkanthi in #813
- Removed logic of duplicating instances of DebeziumOffsetStorage by @subkanthi in #833
- Support MySQL point by @poweroftrue in #815
- Support MySQL Polygons by @poweroftrue in #853
- Added Integration test for testing POINT data type in MySQL by @subkanthi in #851
- Upgrade debezium to 2.7.1.Final by @subkanthi in #792
- Set log retention max size to 100M by @subkanthi in #805
- Added integration test to validate database.override.map in snapshot.mode=initial mode by @subkanthi in #818
- Log docker tag in startup by @subkanthi in #841
- Upgrade clickhouse.jdbc.version to 0.6.5 by @subkanthi in #832
- Single threaded documentation by @subkanthi in #822
- add ddl.retry by @Selfeer in #865
- Refactored DDL processing logic by @subkanthi in #839
- Testflows updates by @Selfeer in #873
- Added test to replicate generated columns in postgreSQL by @subkanthi in #777
- Added function to retrieve a map of column name and is_nullable as bo… by @subkanthi in #852
- Added test for MySQL DDL with partitions by @subkanthi in #784
- 773 add sink connector client step to purge schema history so that newer tables can be added by @subkanthi in #779
New Contributors
- @poweroftrue made their first contribution in #815
Full Changelog: 2.3.0...2
