This repository provides a collection of samples to help you get started with AutoMQ, the next-generation cloud-native streaming platform, covering both open-source and cloud service setups.
- AutoMQ Open Source: A stateless Kafka® on S3, offering 10x cost savings and scaling in seconds under the Apache License 2.0. Due to the nature of object storage, latency can be in the hundreds of milliseconds.
- AutoMQ Cloud Service: Builds upon the open-source version with more shared storage options. It guarantees low latency consistent with Apache Kafka and includes commercial features like Kafka Linking for seamless migration.
The software versions used in the demos within this repository may be outdated. For any real-world use case, please use the latest official releases.
- Open Source Docker Images: Find the latest tags on Docker Hub.
- Open Source Binaries: Download the latest release from GitHub Releases.
- AutoMQ Cloud: View the latest version details in the Cloud Release Notes.
This repository is organized into the following sections:
- Open Source Setup: Deploy AutoMQ open-source version using Docker Compose, Kubernetes, and Ansible.
- Client Examples: Build and run demos for various language clients, including Java, C++, Go, and Python.
- Table Topic Solutions: Explore solutions for append and CDC scenarios with Table Topic, and integrations with Iceberg REST Catalog, AWS Glue, and Hive Metastore.
- Cloud Service Setup: Deploy AutoMQ cloud service on AWS (EC2 and EKS), GCP (Kubernetes), and Azure (Kubernetes) using Terraform.
- Observability: Set up a monitoring stack with Mimir and Grafana for AutoMQ using Docker Compose.
- Kubernetes: Provides Terraform scripts for provisioning Kubernetes clusters on AWS, Azure, and GCP.
- Kafka Linking Demos: Learn how to migrate from any Kafka cluster to AutoMQ with demos for standard clients and Flink applications.
- Auto-Balancing Demos: See how AutoMQ automatically balances workloads based on traffic, QPS, and node health.
Each section contains a detailed README.md file with instructions on how to run the samples. Please refer to the specific section for more information.
Disclaimer: The samples and demonstrations provided in this repository are intended for Proof of Concept (PoC) and testing purposes only. They are not recommended for direct use in a production environment.
For production deployments, we strongly recommend discussing your architecture and best practices with our engineering team to ensure optimal performance, reliability, and cost-efficiency.
Please contact us to get in touch.
We welcome contributions! Please see our contributing guidelines for more information.
This project is licensed under the Apache License 2.0.