Use Cloud Provider Object Storage

AutoMQ is a Kafka distribution reimagined with cloud-native principles, designed to fully leverage object storage cloud services. The following guide shows how to configure AutoMQ for object storage across various major cloud environments.

Dependency on Object Storage Services

AutoMQ uses the AWS S3 SDK to access object storage services, and most cloud service providers support the standard S3 protocol.

<dependency>
    <groupId>software.amazon.awssdk</groupId>
    <artifactId>s3</artifactId>
    <version>2.20.127</version>
</dependency>

Tip

Azure Blob Storage is not compatible with the AWS S3 network protocol, so the open-source version of AutoMQ cannot run directly on Azure Blob Storage. Users can address this by:

Setting up an S3 Proxy to access Blob Storage.

Contact the AutoMQ team for Enterprise Edition support. The AutoMQ Enterprise Edition works with Azure Blob Storage.

Rely on Access Control Policies

To secure your object storage access, you can set a minimum permissions set to limit access. The methods used by major cloud providers are largely similar. For specific configurations, see Deploy Multi-Nodes Cluster on Linux▸.

Deploy AutoMQ

Please refer to the following documents to deploy AutoMQ:

• Deploy Multi-Nodes Cluster on Linux▸

• Deploy Multi-Nodes Cluster on Kubernetes▸