You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/kafka/metrics-monitoring-kafka/README.adoc
+28-22Lines changed: 28 additions & 22 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -106,58 +106,64 @@ As a developer or administrator, you can view metrics in {product-long-kafka} to
106
106
Cluster metrics::
107
107
+
108
108
--
109
-
* `kafka_namespace:haproxy_server_bytes_in_total:rate5m`: Number of incoming bytes per second for the cluster in the last five minutes. This ingress metric represents all the data that producers are sending to topics in the cluster.
109
+
`kafka_namespace:haproxy_server_bytes_in_total:rate5m`:: Number of incoming bytes per second for the cluster in the last five minutes. This ingress metric represents all the data that producers are sending to topics in the cluster.
110
+
+
110
111
The Kafka instance type determines the maximum incoming byte rate.
111
112
112
-
* `kafka_namespace:haproxy_server_bytes_out_total:rate5m`: Number of outgoing bytes per second for the cluster in the last five minutes. This egress metric represents all the data that consumers are receiving from topics in the cluster.
113
+
`kafka_namespace:haproxy_server_bytes_out_total:rate5m`:: Number of outgoing bytes per second for the cluster in the last five minutes. This egress metric represents all the data that consumers are receiving from topics in the cluster.
114
+
+
113
115
The Kafka instance type determines the maximum outgoing byte rate.
114
116
115
-
* `kafka_namespace:kafka_server_socket_server_metrics_connection_count:sum`: Number of current client connections to the cluster. Kafka clients use persistent connections to interact with brokers in the cluster. For example, a consumer holds a connection to each broker it is receiving data from and a connection to its group coordinator.
117
+
`kafka_namespace:kafka_server_socket_server_metrics_connection_count:sum`:: Number of current client connections to the cluster. Kafka clients use persistent connections to interact with brokers in the cluster. For example, a consumer holds a connection to each broker it is receiving data from and a connection to its group coordinator.
118
+
+
116
119
The Kafka instance type determines the maximum number of active connections.
117
-
* `kafka_namespace:kafka_server_socket_server_metrics_connection_creation_rate:sum`: Number of client connection creations per second for the cluster. Kafka clients use persistent connections to interact with brokers in the cluster. A constant high number of connection creations might indicate a client issue.
120
+
121
+
`kafka_namespace:kafka_server_socket_server_metrics_connection_creation_rate:sum`:: Number of client connection creations per second for the cluster. Kafka clients use persistent connections to interact with brokers in the cluster. A constant high number of connection creations might indicate a client issue.
122
+
+
118
123
The Kafka instance type determines the maximum connection creation rate.
119
124
120
-
* `kafka_topic:kafka_topic_partitions:count`: Number of topics in the cluster. This does not include internal Kafka topics, such as `\__consumer_offsets` and `__transaction_state`.
125
+
`kafka_topic:kafka_topic_partitions:count`:: Number of topics in the cluster. This metric does not include internal Kafka topics, such as `\__consumer_offsets` and `__transaction_state`.
121
126
122
-
* `kafka_topic:kafka_topic_partitions:sum`: Number of partitions across all topics in the cluster. This does not include partitions from internal Kafka topics, such as `\__consumer_offsets` and `__transaction_state`.
127
+
`kafka_topic:kafka_topic_partitions:sum`:: Number of partitions across all topics in the cluster. This metric does not include partitions from internal Kafka topics, such as `\__consumer_offsets` and `__transaction_state`.
128
+
+
123
129
The Kafka instance type determines the maximum number of partitions.
124
130
--
125
131
126
132
Broker metrics::
127
133
+
128
134
--
129
-
* `kafka_broker_quota_softlimitbytes`: Maximum amount of storage, in bytes, for this broker before producers are throttled. When this limit is reached, the broker starts throttling producers to prevent them from sending additional data.
135
+
`kafka_broker_quota_softlimitbytes`:: Maximum amount of storage, in bytes, for this broker before producers are throttled. When this limit is reached, the broker starts throttling producers to prevent them from sending additional data.
136
+
+
130
137
The Kafka instance type determines the maximum storage in the broker.
131
138
132
-
* `kafka_broker_quota_totalstorageusedbytes`: Amount of storage, in bytes, that is currently used by partitions in the broker. The storage usage depends on the number and retention configurations of the partitions. This metric must stay below the `kafka_broker_quota_softlimitbytes` metric setting.
139
+
`kafka_broker_quota_totalstorageusedbytes`:: Amount of storage, in bytes, that is currently used by partitions in the broker. The storage usage depends on the number and retention configurations of the partitions. This metric must stay below the `kafka_broker_quota_softlimitbytes` value.
133
140
134
-
* `kafka_controller_kafkacontroller_global_partition_count`: Number of partitions in the cluster. Only the broker that is the current controller in the cluster reports this metric. Any other brokers report `0`. This count includes partitions from internal Kafka topics, such as `\__consumer_offsets` and `__transaction_state`. This metric is similar to the `kafka_topic:kafka_topic_partitions:sum` cluster metric.
135
-
The Kafka instance type determines the maximum storage in the broker.
141
+
`kafka_controller_kafkacontroller_global_partition_count`:: Number of partitions in the cluster. Only the broker that is the current controller in the cluster reports this metric. Any other brokers report a value of `0`. This count includes partitions from internal Kafka topics, such as `\__consumer_offsets` and `__transaction_state`. This metric is similar to the `kafka_topic:kafka_topic_partitions:sum` cluster metric.
136
142
137
-
* `kafka_controller_kafkacontroller_offline_partitions_count`: Number of partitions in the cluster that are currently offline. Offline partitions cannot be used by clients for producing or consuming data. Only the broker that is the current controller in the cluster reports this metric. Any other brokers report `0`.
143
+
`kafka_controller_kafkacontroller_offline_partitions_count`:: Number of partitions in the cluster that are currently offline. Offline partitions cannot be used by clients for producing or consuming data. Only the broker that is the current controller in the cluster reports this metric. Any other brokers report `0`.
138
144
139
-
* `kubelet_volume_stats_available_bytes`: Amount of disk space, in bytes, that is available in the broker.
145
+
`kubelet_volume_stats_available_bytes`:: Amount of disk space, in bytes, that is available in the broker.
140
146
141
-
* `kubelet_volume_stats_used_bytes`: Amount of disk space, in bytes, that is currently used in the broker. This metric is similar to the `kafka_broker_quota_totalstorageusedbytes` broker metric.
147
+
`kubelet_volume_stats_used_bytes`:: Amount of disk space, in bytes, that is currently used in the broker. This metric is similar to the `kafka_broker_quota_totalstorageusedbytes` broker metric.
142
148
--
143
149
144
150
Topic metrics::
145
151
+
152
+
--
153
+
`kafka_server_brokertopicmetrics_bytes_in_total`:: Number of incoming bytes to topics in the instance.
146
154
147
-
* `kafka_server_brokertopicmetrics_bytes_in_total`: Number of incoming bytes to topics in the instance.
148
-
149
-
* `kafka_server_brokertopicmetrics_bytes_out_total`: Number of outgoing bytes from topics in the instance.
150
-
151
-
* `kafka_server_brokertopicmetrics_messages_in_total`: Number of messages per second received by one or more topics in the instance.
155
+
`kafka_server_brokertopicmetrics_bytes_out_total`:: Number of outgoing bytes from topics in the instance.
152
156
153
-
* `kafka_topic:kafka_server_brokertopicmetrics_bytes_in_total:rate5m`: Number of incoming bytes to topics in the instance in the last five minutes.
157
+
`kafka_server_brokertopicmetrics_messages_in_total`:: Number of messages per second received by one or more topics in the instance.
154
158
155
-
* `kafka_topic:kafka_server_brokertopicmetrics_bytes_out_total:rate5m`: Number of outgoing bytes from topics in the instance in the last five minutes.
159
+
`kafka_topic:kafka_server_brokertopicmetrics_bytes_in_total:rate5m`:: Number of incoming bytes to topics in the instance in the last five minutes.
156
160
157
-
* `kafka_topic:kafka_server_brokertopicmetrics_messages_in_total:rate5m`: Number of messages per second received by one or more topics in the instance in the last five minutes.
161
+
`kafka_topic:kafka_server_brokertopicmetrics_bytes_out_total:rate5m`:: Number of outgoing bytes from topics in the instance in the last five minutes.
158
162
159
-
* `kafka_topic:kafka_log_log_size:sum`: Log size of each topic and replica, in bytes, across all brokers in the cluster.
163
+
`kafka_topic:kafka_server_brokertopicmetrics_messages_in_total:rate5m`:: Number of messages per second received by one or more topics in the instance in the last five minutes.
160
164
165
+
`kafka_topic:kafka_log_log_size:sum`:: Log size, in bytes, of each topic and replica across all brokers in the cluster.
166
+
--
161
167
162
168
[id="proc-viewing-metrics_{context}"]
163
169
== Viewing metrics for a Kafka instance in {product-kafka}
0 commit comments