The MySQL Debezium demo shows an end-to-end streaming ETL with KSQL for stream processing. This demo uses the Debezium Connector for MySQL
- Common demo prerequisites
- Confluent Platform 5.3
- MySQL
- Validated on MacOS 10.14.3 with MySQL server version 5.7.25
- Enable binary log
- Elasticsearch 5.6.5 to export data from Kafka
- If you do not want to use Elasticsearch, comment out
check_running_elasticsearchin thestart.shscript
- If you do not want to use Elasticsearch, comment out
- Kibana 5.5.2 to visualize data
- If you do not want to use Kibana, comment out
check_running_kibanain thestart.shscript
- If you do not want to use Kibana, comment out
After you run ./start.sh:
- If you are running Confluent Platform, open your browser and navigate to the Control Center web interface Monitoring -> Data streams tab at http://localhost:9021/monitoring/streams to see throughput and latency performance of the KSQL queries
- If you are running Confluent Platform, use Control Center to view and create KSQL queries. Otherwise, run the KSQL CLI
ksql http://localhost:8088. - Navigate to the Kibana dashboard at http://localhost:5601/app/kibana#/dashboard/Ratings
- Consult live-coding.adoc to inspect the topics.
