Overview
This document explains how to monitor, set up alerts, and visualize dashboards when using AutoMQ.
Metrics Collection
AutoMQ is fully compatible with Apache Kafka. Along with supporting native Kafka metrics, it also introduces new system metrics such as S3 Stream. AutoMQ system metrics are exposed in the following ways:
-
Native JMX Metrics Query: The open-source version of AutoMQ supports Apache Kafka's native JMX metrics query. All metrics can be accessed through the JMX API.
-
Integrating Metrics with Prometheus▸: The open-source version of AutoMQ utilizes the OpenTelemetry SDK for metrics collection and export. Users can deploy an OTLP Collector or use components like Prometheus OTLP Receiver to report and transfer metrics to Prometheus.
Visualization & Monitoring Alerts
In real-world production environments, the AutoMQ team has set up a collection of Grafana dashboard templates and monitoring alert templates. Once users export metrics to Prometheus, they can import these Grafana dashboard templates and configure the Grafana data source to align with Prometheus, thereby starting the monitoring of AutoMQ.
To obtain the Grafana dashboard templates and monitoring alert templates, you can contact the AutoMQ team by filling out the form.