Restrictions
Overview
In order to avoid various edge cases in the production environment due to undefined behavior, AutoMQ Cloud places constraints and specifications on parameters, quotas, and behaviors within the product scope. Users need to ensure they do not violate these constraints during usage. If any constraint does not meet the actual usage scenario, please promptly submit a ticket for assistance. Refer to Obtaining Services▸.
Parameter Limitations
The naming and annotation limitation values for the following parameters and resources cannot be adjusted. Please strictly adhere to the specifications to avoid system processing anomalies caused by special characters or length overflows.
Public Parameter Limitations
Parameter | Constraint Value | Description |
---|---|---|
Instance Name |
| Names and notes should preferably use concise, common phrases and abbreviations, avoiding special characters that may cause display anomalies. |
Instance Notes |
| |
Environment Member Name |
| |
Environment Member Password |
| |
Integration Name |
| |
Reassignment Name |
|
Instance-Level Configuration
Parameter | Constraint Value | Description |
---|---|---|
log.retention.ms Message Retention Duration |
| The message retention duration affects storage space consumption and costs. It is recommended to evaluate your business needs accordingly. If it cannot be met, please seek help by referring to Obtaining Services▸. |
message.max.bytes Maximum message size |
| If the current parameter limit does not meet your needs, please Obtain Services▸ for assistance. |
offsets.retention.minutes Retention period for consumer offsets |
| |
fetch.max.bytes Limit for a single fetch |
| |
Single partition write throughput limit |
| Single partition read/write throughput has limitations. It is recommended that applications use different message keys to distribute the read/write load across different partitions to avoid partition hotspots. Please Obtaining Services▸ for assistance. |
Single Partition Read Throughput Limit |
| |
auto.create.topics.enable Auto Create Topics Switch |
| It is recommended to disable the auto creation of topics and manage all topics via the control system and Admin API to avoid unmanaged topics. |
num.partitions Default number of partitions created for a Topic |
| The default number of partitions created for a Topic is used when automatically creating topics. It is recommended to set this at the cluster level reasonably to avoid excessive resource consumption due to automatic topic creation. |
Topic-level Configuration
Parameter | Constraint Value | Description |
---|---|---|
compression.type |
| Set the final compression type for the Topic. This configuration supports ('gzip', 'snappy', 'lz4', 'zstd'). Besides these options, 'uncompressed' is supported, which means no compression. The 'producer' value indicates retaining the producer's configured compression type. |
cleanup.policy Message cleanup policy |
| The delete type is recommended for most business scenarios. Use the compact type only when retaining state data. |
retention.ms |
| Set the custom retention time for topic messages. This is only effective for topics with a cleanup policy of type "delete". This configuration will override the cluster default configuration. |
max.message.bytes |
| Set the maximum allowed size for record batches in the current topic. Messages exceeding this limit will be rejected. |
message.timestamp.type |
| Define whether the timestamp in the message is the message creation time or the log append time. This value should be 'CreateTime' or 'LogAppendTime'. |
retention.bytes |
| This setting is effective for topics with the delete cleanup policy, controlling the upper limit of retained data space per partition. By default, there is no size limit, only a time limit. This constraint is on the partition level, so multiply it by the number of partitions to calculate the topic-level retention space. This configuration overrides the cluster default settings. |
delete.retention.ms |
| This setting specifies the retention time for deletion tombstone records for compacted topics. It is only effective for compacted topics. Consumers must read the messages within this time frame to possibly obtain the latest valid snapshot; otherwise, consumers may read incomplete data. |
Topic Naming |
| None. |
Topic notes |
| |
automq.table.topic.enable |
| Configure whether to enable AutoMQ Table Topic. When enabled, an Iceberg Table will be created to store AutoMQ Table data. |
automq.table.topic.commit.interval.ms |
| Set the data submission interval for the AutoMQ Table Topic. The shorter the submission interval, the higher the data real-time processing accuracy, but it will also increase the processing cost, and vice versa. |
automq.table.topic.namespace |
| Namespace of the Table Topic within the catalog. |
automq.table.topic.upsert.enable |
| Controls whether to enable the Upsert feature for the Table Topic. When enabled, the system will automatically decide whether to insert a new record or update an existing one based on the primary key. |
automq.table.topic.partition.by |
| Defines the partitioning rules for the Table Topic using fields or functions to partition the data. For example, |
automq.table.topic.id.columns |
| Specify the unique primary key column(s) of the table (composite primary key), used to identify row-level data. The value is a combination of columns separated by commas, such as |
automq.table.topic.cdc.field |
| Specify the field name that records the CDC (Change Data Capture) operation type. This field identifies the type of database change operation, with values such as |
automq.table.topic.schema.type |
| Supports two modes: |
Resource Quota Limitations
AutoMQ Cloud, leveraging operational experience from large-scale production environments, imposes initial constraints on certain performance metrics and parameters within the product. In most cases, the default constraints meet the requirements; however, if there are special circumstances where they do not, please promptly submit a support ticket for assistance.
Environmental Public Resource Quota Limits
Constraint Item | Constraint Value | Description |
---|---|---|
Total number of product instances allowed within a single environment | Refer to subscription plan constraints | If the current limitations are unsatisfactory, seek help through a work order Obtaining Services▸ . |
Number of member accounts in a single environment | 100 accounts |
Instance Quota Limitations
AutoMQ Cloud, leveraging operational experience from large-scale production environments, imposes initial constraints on certain performance metrics and parameters within the product. In most cases, the default constraints meet the requirements; however, if there are special circumstances where they do not, please promptly submit a support ticket for assistance.
Constraint Item | Constraint Value | Description |
---|---|---|
Single instance (cluster) computing specifications | 3AKU ~ 500AKU, offering the following capabilities:
| Instance computing specifications represent the maximum throughput capacity for receiving and processing messages in a single instance (cluster). For larger cluster demands, please Obtaining Services▸ to apply for higher specifications. |
Maximum Number of Topics per Single Instance | Determined by the compute specifications of the created instance. Please refer to the specific specification restrictions Billing Instructions for BYOC▸ . | For security and stability, it is recommended to distribute different businesses across separate instances to avoid concentrating all businesses in a single instance. |
Maximum Number of Partitions per Single Instance (Cluster) | ||
Maximum QPS per Single Instance (Cluster) |
BYOC Region Restrictions
- AWS
- GCP
- Alibaba Cloud
- Tencent Cloud
- Huawei Cloud
Code | Name |
---|---|
us-east-1 | US East (N. Virginia) |
us-east-2 | US East (Ohio) |
us-west-1 | US West (N. California) |
us-west-2 | US West (Oregon) |
af-south-1 | Africa (Cape Town) |
ap-east-1 | Asia Pacific (Hong Kong) |
ap-south-2 | Asia Pacific (Hyderabad) |
ap-southeast-3 | Asia Pacific (Jakarta) |
ap-southeast-5 | Asia Pacific (Malaysia) |
ap-southeast-4 | Asia Pacific (Melbourne) |
ap-south-1 | Asia Pacific (Mumbai) |
ap-northeast-3 | Asia Pacific (Osaka) |
ap-northeast-2 | Asia Pacific (Seoul) |
ap-southeast-1 | Asia Pacific (Singapore) |
ap-southeast-2 | Asia Pacific (Sydney) |
ap-northeast-1 | Asia Pacific (Tokyo) |
ca-central-1 | Canada (Central) |
ca-west-1 | Canada West (Calgary) |
cn-north-1 | China (Beijing) |
cn-northwest-1 | China (Ningxia) |
eu-central-1 | Europe (Frankfurt) |
eu-west-1 | Europe (Ireland) |
eu-west-2 | Europe (London) |
eu-south-1 | Europe (Milan) |
eu-west-3 | Europe (Paris) |
eu-south-2 | Europe (Spain) |
eu-north-1 | Europe (Stockholm) |
eu-central-2 | Europe (Zurich) |
il-central-1 | Israel (Tel Aviv) |
me-south-1 | Middle East (Bahrain) |
me-central-1 | Middle East (UAE) |
sa-east-1 | South America (São Paulo) |
Region ID | Name |
---|---|
us-west-1 | Oregon |
asia-south1 | Mumbai |
asia-south2 | Delhi |
asia-east1 | Changhua County |
asia-east2 | Hong Kong |
asia-northeast1 | Tokyo |
asia-northeast2 | Osaka |
asia-northeast3 | Seoul |
asia-southeast1 | Jurong West |
australia-southeast1 | Sydney |
australia-southeast2 | Melbourne |
europe-central2 | Warsaw |
europe-north2 | Hamina |
europe-southwest1 | Madrid |
europe-west1 | St. Ghislain |
europe-west2 | London |
europe-west3 | Frankfurt |
europe-west4 | Eemshaven |
europe-west6 | Zurich |
europe-west8 | Milan |
europe-west9 | Paris |
northamerica-northeast1 | Montréal |
northamerica-northeast2 | Toronto |
southamerica-east1 | Osasco |
us-central1 | Council Bluffs |
us-east1 | Moncks Corner |
us-east4 | Ashburn |
us-west1 | The Dalles |
us-west2 | Los Angeles |
us-west3 | Salt Lake City |
us-west4 | Las Vegas |
Region ID | Name |
---|---|
cn-qingdao | North China 1 (Qingdao) |
cn-beijing | North China 2 (Beijing) |
cn-zhangjiakou | North China 3 (Zhangjiakou) |
cn-hangzhou | East China 1 (Hangzhou) |
cn-shanghai | East China 2 (Shanghai) |
cn-shenzhen | South China 1 (Shenzhen) |
cn-guangzhou | South China 3 (Guangzhou) |
cn-hongkong | China (Hong Kong) |
ap-southeast-1 | Asia Pacific Southeast 1 (Singapore) |
us-east-1 | US East 1 (Virginia) |
us-west-1 | US West 1 (Silicon Valley) |
eu-central-1 | Europe Central 1 (Frankfurt) |
Region ID | Name |
---|---|
ap-singapore | Singapore |
na-siliconvalley | Silicon Valley |
ap-guangzhou | Guangzhou |
ap-beijing | Beijing |
eu-frankfurt | Frankfurt |
ap-chengdu | Chengdu |
ap-nanjing | Nanjing |
ap-chongqing | Chongqing |
ap-hongkong | Hong Kong, China |
ap-tokyo | Tokyo |
ap-shanghai | Shanghai |
Region ID | Name |
---|---|
cn-southwest-1 | Southwest-Guian |
ap-southeast-1 | Asia Pacific-Singapore |
cn-north-4 | North China-Beijing 4 |
cn-north-2 | North China - Beijing 2 |
cn-south-1 | South China - Guangzhou |
eu-central-1 | Turkey - Istanbul |
cn-hongkong | China - Hong Kong |
cn-south-2 | South China - Shenzhen |
cn-east-1 | East China - Shanghai 1 |
cn-north-1 | North China - Beijing 1 |
cn-north-5 | North China - Ulanqab 1 |