Community Impact

AutoMQ GitHub Stars have officially surpassed 7,000!

Why are more businesses and developers choosing AutoMQ?

• 100% Kafka API Compatibility : Enjoy seamless reassignment with no vendor lock-in, fully compatible with the entire Kafka ecosystem.

• Diskless Architecture : Utilizes a stateless broker to scale up or down within seconds, reducing elastic scaling costs.

• Kubernetes Native : Specifically designed for Kubernetes, highly compatible with mainstream deployment solutions like Strimzi Operator and Bitnami Kafka Chart.

• Zero Inter-AZ Costs : Features shared storage architecture to avoid high fees associated with inter-availability zone traffic.

• Automatic Data Balancing : Integrated Self-Balancing system reassigns partitions within a second, effectively eliminating hotspots.

Latest Release

Kafka Linking Reassignment Tool

• Zero Downtime Reassignment: AutoMQ allows data reassignment from the old cluster to the new cluster without impacting applications running in the current production environment, ensuring a seamless transition.

• Reassignment with Offset Retention: For data infrastructures that rely on Kafka consumer offsets (such as Flink jobs), retaining these offsets during cluster reassignment is essential. This facilitates the migration of Kafka to AutoMQ without necessitating changes to the existing data infrastructure, significantly simplifying the cluster reassignment process.

• Synchronize All Data: All data and metadata in the Kafka cluster are synchronized, including Topics, Consumer Groups, and Offsets.

Table Topic

• Out-of-the-box: AutoMQ's Table Topic capabilities automatically convert Kafka Topics into Iceberg Tables using S3 Tables, enabling continuous, real-time analysis.

• Built-in Schema Registry: Table Topic automatically creates Iceberg tables within catalog services like AWS Glue using registered schemas and supports automatic schema evolution.

• No ETL (Extract, Transform, Load): By utilizing S3's high throughput and AutoMQ's fine-grained scheduling, Table Topic facilitates real-time data extraction of several GiB per second while continuously compressing small files to optimize query performance, thereby achieving true zero ETL processing from Kafka to the data lake.

• Auto Scaling: AutoMQ boasts a stateless and elastic architecture that allows brokers to seamlessly scale in or out through dynamic partition reassignment. Table Topic uses this framework to effortlessly manage ingestion rates ranging from several hundred MiB/s to several GiB/s.

• Seamless Integration with AWS S3 Table: Table Topic seamlessly integrates with S3 Table, fully leveraging its data cataloging and maintenance features such as compression, snapshot management, and orphan file deletion. This integration also supports large-scale data analysis via AWS Athena.

Operations channel

AutoMQ BYOC environments support Ops Tunnel, enabling users to establish secure, trusted, and auditable operational channels. This function allows AutoMQ technicians temporary access to the BYOC environment for the purpose of troubleshooting and analyzing complex issues.

Azure Deployment

Microsoft Azure backs AutoMQ BYOC deployments. On Azure, it utilizes Azure’s underlying storage (such as Blob Storage) and compute resources to facilitate pay-as-you-go billing, automatically scaling down during low traffic periods, even to zero, which saves users significant costs.

Announcement Preview

AutoMQ Managed Connector is coming soon

• Provides comprehensive hosting and maintenance for Connectors, streamlining ETL pipeline management.

• Features popular plugins like S3, Debezium CDC, and ElasticSearch, and allows users to upload custom plugins.

• Offers extensive metrics and log observability capabilities, along with support for elastic scaling and automated operations.

AutoMQ BYOC Installation Experience Enhanced

• Streamline the installation process and guide with Docker for a one-click Console launch to reduce operational barriers.

• Download IAM authorization templates with a single click to optimize the authorization scope and simplify the operational process.

Stay tuned for updates to AutoMQ.

AutoMQ BYOC now offers a 14-day free trial benefit; start your trial right away!

Scan the QR code to join the group and stay updated on daily product news.