Restrictions
Overview
To prevent various edge cases in production caused by unclear behavior definitions, AutoMQ Cloud enforces and standardizes parameters, quotas, and behaviors across its products. Users should ensure they do not violate these constraints while using the system. If these constraints do not align with actual usage scenarios, please promptly submit a support ticket for assistance, as referenced in Obtaining Services▸.
Limitations on Parameters
The names and descriptions of resources within the following parameters have restricted values that cannot be adjusted. Please adhere strictly to the specifications to prevent system processing anomalies caused by special characters or excessive length.
Public Parameter Limitations
Parameter Items | Limit Value | Description |
---|---|---|
Instance Name |
| Names and notes should preferably use simple, common phrases and abbreviations. Avoid using special characters that may cause display issues. |
Instance Notes |
| |
Environment Member Name |
| |
Environment Member Password |
| |
Integration Name |
| |
Reassignment Name |
|
Instance-Level Configuration
Parameter Items | Limit Value | Description |
---|---|---|
log.retention.ms Message Retention Period |
| The message retention period affects storage space consumption and cost. It is advisable for businesses to assess this carefully. If unsatisfactory, please Obtaining Services▸ Seek assistance. |
message.max.bytes Maximum message size |
| If the current parameter limit does not meet your needs, please Obtaining Services▸ seek assistance. |
offsets.retention.minutes Consumption Progress Retention Duration |
| |
fetch.max.bytes Single Data Fetch Limit |
| |
Single partition write throughput limit |
| There are limitations on single partition read/write throughput. It is recommended that applications use different message keys to distribute the read/write load across different partitions to avoid partition hotspots. Please Obtaining Services▸ Seeking Assistance. |
Single Partition Read Throughput Limit |
| |
auto.create.topics.enable Auto-create Topic Switch |
| It is recommended to disable the automatic creation of topics and instead manage all topics through the control system and Admin API to prevent them from becoming unmanageable. |
num.partitions Default number of partitions for created topics |
| The default number of partitions to create for a topic when using automatic topic creation should be set reasonably at the cluster level to avoid consuming too many of the partition quota with automatically created topics. |
automq.zone.cidr.blocks Client source CIDR availability zone identification |
| The server matches the CIDR set in the current rule with the client's source IP to determine the client's corresponding availability zone. This configuration is used to optimize and eliminate cross-availability zone traffic for clients. The format specification for CIDR is {zoneId}@{cidr}<>{zoneId}@{cidr}. Different availability zones are separated by "<>", while multiple CIDR segments under the same availability zone are separated by ",". Example:
Note: In the AWS environment, the availability zone identifier should be set as ZoneID rather than ZoneName. Regarding the difference between the two Reference Documentation 。 |
Topic-Level Configuration
Parameter Items | Limit Value | Description |
---|---|---|
compression.type |
| Set the final compression type for the Topic. This configuration supports ('gzip', 'snappy', 'lz4', 'zstd'); in addition to these options, it also supports 'uncompressed', meaning no compression is applied. The 'producer' configuration value refers to retaining the compression type set by the producer. |
cleanup.policy Message cleanup policy |
| In most business scenarios, it is recommended to use the delete type, and only use the compact type in scenarios where preserving state data is required. |
retention.ms |
| Configure a custom retention period for messages in a topic, applicable only to topics with a deletion clean-up policy. This configuration will override the default cluster settings. |
max.message.bytes |
| Set the maximum allowable record batch size for the current topic, and any messages exceeding this limit will be rejected. |
message.timestamp.type |
| Define whether the timestamp in the message corresponds to the message's creation time or the log append time. This value should be either 'create time' or 'log append time'. |
retention.bytes |
| This setting applies to topics with a delete cleanup policy and controls the maximum retention space for each partition. By default, there is no size limit, only a time limit. This restriction is at the partition level, so multiply it by the number of partitions to compute the topic-level retention space. This configuration overrides the cluster's default settings. |
delete.retention.ms |
| Set the retention time for deletion tombstones for Compact-type Topics, applicable only to Compact-type Topics. This configuration requires consumers to read messages within this timeframe to obtain the last valid snapshot; otherwise, they may read incomplete data. |
Topic Naming |
| None. |
Topic Notes |
| |
automq.table.topic.enable |
| Configure whether to enable AutoMQ Table Topic. When enabled, an Iceberg Table will be created for storing AutoMQ Table data. |
automq.table.topic.commit.interval.ms |
| Set the data submission interval for AutoMQ Table Topic. A shorter submission interval increases data real-time performance but also raises processing costs, and vice versa. |
automq.table.topic.namespace |
| Table Topic is within the Namespace in the Catalog. |
automq.table.topic.upsert.enable |
| Control whether the Upsert feature of the Table Topic is enabled. Once enabled, the system automatically determines whether to insert a new record or update an existing record based on the primary key. |
automq.table.topic.partition.by |
| Define the partitioning rules of the Table Topic by partitioning the data through fields or functions. For example, |
automq.table.topic.id.columns |
| Specify the unique primary key column (composite primary key) of the table used to identify row-level data. The value is a comma-separated combination of columns, for example, |
automq.table.topic.cdc.field |
| Specifies the field name for recording CDC (Change Data Capture) operation types. It identifies the type of database change operations, with values being a single character: |
automq.table.topic.schema.type |
| Supports two modes: |
Resource Quota Limits
AutoMQ Cloud has established initial constraints on certain performance metrics and parameters based on its operational experience in large-scale production environments. In most cases, the default constraint range will meet your needs. However, if there are special circumstances where these do not suffice, please promptly submit a support ticket for assistance.
Environmental Public Resource Quota Limits
Limit Item | Limit Value | Description |
---|---|---|
Total number of product instances allowed within a single environment | Refer to subscription plan version constraints | If current constraints are not met, seek help through a support ticket. Obtaining Services▸ 。 |
Number of member accounts in a single environment: | 100 |
Instance Quota Limitations:
AutoMQ Cloud has established initial constraints on certain performance metrics and parameters based on its operational experience in large-scale production environments. In most cases, the default constraint range will meet your needs. However, if there are special circumstances where these do not suffice, please promptly submit a support ticket for assistance.
Limit Item | Limit Value | Description |
---|---|---|
Single Instance (Cluster) Computing Specification | 3AKU to 500AKU, offering the following capabilities:
| The instance's compute specification denotes the maximum throughput capacity for sending and receiving messages on a single instance (cluster). If there's a need for larger-scale clusters, please Obtaining Services▸ apply to raise the specification limits. |
Limits on the Number of Topics per Instance | Defined by the compute specifications of the instance; see specification limits for further details. Billing Instructions for BYOC▸ 。 | For security and stability purposes, it's advisable to separate different business operations into distinct instances to avoid consolidating all operations into one instance. |
Maximum Number of Partitions per Single Instance (Cluster) | ||
Maximum Request QPS per Single Instance (Cluster) |
BYOC Version Deployment Region Restrictions
- AWS
- GCP
- Alibaba Cloud
- Tencent Cloud
- Huawei Cloud
Code | Name |
---|---|
us-east-1 | US East (N. Virginia) |
us-east-2 | US East (Ohio) |
us-west-1 | US West (N. California) |
us-west-2 | US West (Oregon) |
af-south-1 | Africa (Cape Town) |
ap-east-1 | Asia Pacific (Hong Kong) |
ap-south-2 | Asia Pacific (Hyderabad) |
ap-southeast-3 | Asia Pacific (Jakarta) |
ap-southeast-5 | Asia Pacific (Malaysia) |
ap-southeast-4 | Asia Pacific (Melbourne) |
ap-south-1 | Asia Pacific (Mumbai) |
ap-northeast-3 | Asia Pacific (Osaka) |
ap-northeast-2 | Asia Pacific (Seoul) |
ap-southeast-1 | Asia Pacific (Singapore) |
ap-southeast-2 | Asia Pacific (Sydney) |
ap-northeast-1 | Asia Pacific (Tokyo) |
ca-central-1 | Canada (Central) |
ca-west-1 | Canada West (Calgary) |
cn-north-1 | China (Beijing) |
cn-northwest-1 | China (Ningxia) |
eu-central-1 | Europe (Frankfurt) |
eu-west-1 | Europe (Ireland) |
eu-west-2 | Europe (London) |
eu-south-1 | Europe (Milan) |
eu-west-3 | Europe (Paris) |
eu-south-2 | Europe (Spain) |
eu-north-1 | Europe (Stockholm) |
eu-central-2 | Europe (Zurich) |
il-central-1 | Israel (Tel Aviv) |
me-south-1 | Middle East (Bahrain) |
me-central-1 | Middle East (UAE) |
sa-east-1 | South America (São Paulo) |
Region ID | Name |
---|---|
us-west-1 | Oregon |
asia-south1 | Mumbai |
asia-south2 | Delhi |
asia-east1 | Changhua County |
asia-east2 | Hong Kong |
asia-northeast1 | Tokyo |
asia-northeast2 | Osaka |
asia-northeast3 | Seoul |
asia-southeast1 | Jurong West |
australia-southeast1 | Sydney |
australia-southeast2 | Melbourne |
europe-central2 | Warsaw |
europe-north2 | Hamina |
europe-southwest1 | Madrid |
europe-west1 | St. Ghislain |
europe-west2 | London |
europe-west3 | Frankfurt |
europe-west4 | Eemshaven |
europe-west6 | Zurich |
europe-west8 | Milan |
europe-west9 | Paris |
northamerica-northeast1 | Montréal |
northamerica-northeast2 | Toronto |
southamerica-east1 | Osasco |
us-central1 | Council Bluffs |
us-east1 | Moncks Corner |
us-east4 | Ashburn |
us-west1 | The Dalles |
us-west2 | Los Angeles |
us-west3 | Salt Lake City |
us-west4 | Las Vegas |
Region ID | Name |
---|---|
cn-qingdao | North China 1 (Qingdao) |
cn-beijing | North China 2 (Beijing) |
cn-zhangjiakou | North China 3 (Zhangjiakou) |
cn-hangzhou | East China 1 (Hangzhou) |
cn-shanghai | East China 2 (Shanghai) |
cn-shenzhen | South China 1 (Shenzhen) |
cn-guangzhou | South China 3 (Guangzhou) |
cn-hongkong | China (Hong Kong) |
ap-southeast-1 | Asia Pacific Southeast 1 (Singapore) |
us-east-1 | US East 1 (Virginia) |
us-west-1 | US West 1 (Silicon Valley) |
eu-central-1 | EU Central 1 (Frankfurt) |
Region ID | Name |
---|---|
ap-singapore | Singapore |
na-siliconvalley | Silicon Valley |
ap-guangzhou | Guangzhou |
ap-beijing | Beijing |
eu-frankfurt | Frankfurt |
ap-chengdu | Chengdu |
ap-nanjing | Nanjing |
ap-chongqing | Chongqing |
ap-hongkong | Hong Kong, China |
ap-tokyo | Tokyo |
ap-shanghai | Shanghai |
Region ID | Name |
---|---|
cn-southwest-1 | Southwest-Guizhou One |
ap-southeast-1 | Asia Pacific-Singapore |
cn-north-4 | North China-Beijing Four |
cn-north-2 | North China - Beijing 2 |
cn-south-1 | South China - Guangzhou |
eu-central-1 | Turkey - Istanbul |
cn-hongkong | China - Hong Kong |
cn-south-2 | South China - Shenzhen |
cn-east-1 | East China - Shanghai 1 |
cn-north-1 | North China - Beijing 1 |
cn-north-5 | North China - Ulanqab 1 |