You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Sep 2, 2025. It is now read-only.
Copy file name to clipboardExpand all lines: gdi/monitors-hosts/kafka-consumer.rst
+6-10Lines changed: 6 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,19 +6,15 @@ Kafka consumer
6
6
.. meta::
7
7
:description: Use this Splunk Observability Cloud integration for the Collectd Java-based Kafka consumer monitor. See benefits, install, configuration, and metrics
8
8
9
-
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the
10
-
``collectd/kafka_consumer`` monitor type to monitor a Java-based Kafka
11
-
consumer. It has a set of built-in MBeans to pull metrics from the Kafka
12
-
consumer's JMX endpoint.
9
+
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the ``collectd/kafka_consumer`` monitor type to monitor a Java-based Kafka consumer.
13
10
14
11
.. note:: To monitor Kafka with the OpenTelemetry Collector using native OpenTelemetry components refer to the :ref:`kafkametrics-receiver`.
15
12
16
-
This integration is only available on Kubernetes and Linux. It requires
17
-
Kafka version 0.9.0.0 or higher and collects metrics from the new
18
-
consumer API. Per-topic metrics are not available through the new
19
-
consumer API in version 0.9.0.0 or lower, which can cause the logs to
20
-
fill with warnings related to the MBean not being found. Use the
21
-
``mBeansToOmit`` config option in such cases.
13
+
This integration has a set of built-in MBeans to pull metrics from the Kafka consumer's JMX endpoint. For more information, see :new-page:`Kafka consumer MBeans <https://github.com/signalfx/signalfx-agent/tree/main/pkg/monitors/collectd/kafkaconsumer/mbeans.go>` in GitHub.
14
+
15
+
This integration is only available on Kubernetes and Linux, and requires Kafka version 0.9.0.0 or higher.
16
+
17
+
Per-topic metrics are not available through the new consumer API in version 0.9.0.0 or lower, which can cause the logs to fill with warnings related to the MBean not being found. Use the ``mBeansToOmit`` config option in such cases.
Copy file name to clipboardExpand all lines: gdi/monitors-hosts/kafka-producer.rst
+4-7Lines changed: 4 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,16 +6,13 @@ Kafka producer
6
6
.. meta::
7
7
:description: Use this Splunk Observability Cloud integration for the Collectd Java-based Kafka producer monitor. See benefits, install, configuration, and metrics
8
8
9
-
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the
10
-
``collectd/kafka_producer`` monitor type to monitor a Java-based Kafka
11
-
producer. It has a set of built-in MBeans to pull metrics from the Kafka
12
-
consumer's JMX endpoint.
9
+
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the ``collectd/kafka_producer`` monitor type to monitor a Java-based Kafka producer.
13
10
14
11
.. note:: To monitor Kafka with the OpenTelemetry Collector using native OpenTelemetry components refer to the :ref:`kafkametrics-receiver`.
15
12
16
-
This integration is only available on Kubernetes and Linux. It requires
17
-
Kafka version 0.9.0.0 or higher and collects metrics from the new
18
-
producer API.
13
+
This integration has a set of built-in MBeans to pull metrics from the Kafka producer's JMX endpoint. For more information, see :new-page:`Kafka producer MBeans <https://github.com/signalfx/signalfx-agent/tree/main/pkg/monitors/collectd/kafkaproducer/mbeans.go>` in GitHub.
14
+
15
+
This integration is only available on Kubernetes and Linux, and requires Kafka version 0.9.0.0 or higher.
Copy file name to clipboardExpand all lines: gdi/monitors-languages/genericjmx.rst
+4-6Lines changed: 4 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,12 +6,10 @@ GenericJMX
6
6
.. meta::
7
7
:description: Use this Splunk Observability Cloud integration for the GenericJMX monitor. See benefits, install, configuration, and metrics
8
8
9
-
The Splunk Distribution of OpenTelemetry Collector uses the Smart Agent receiver with the
10
-
``genericjmx`` monitor to expose metrics on Java Management Extensions
11
-
(JMX), a generic framework to provide and query management information.
12
-
The interface is used by the Java Virtual Machine (JVM) to provide
13
-
information about the memory used and threads. For a more flexible
14
-
alternative, use :ref:`the JMX monitor <genericjmx>`
9
+
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the ``genericjmx`` monitor to expose metrics on Java Management Extensions (JMX), a generic framework to provide and query management information. The interface is used by the Java Virtual Machine (JVM) to provide
10
+
information about the memory used and threads. For a more flexible alternative, use :ref:`the JMX monitor <genericjmx>`.
11
+
12
+
.. note:: To monitor JMX with the OpenTelemetry Collector using native OpenTelemetry components refer to the :ref:`jmx-receiver`.
15
13
16
14
This integration is only available on Kubernetes and Linux.
Copy file name to clipboardExpand all lines: gdi/monitors-languages/jmx.rst
+7-8Lines changed: 7 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,16 +6,15 @@ JMX
6
6
.. meta::
7
7
:description: Use this Splunk Observability Cloud integration for the JMX monitor. See benefits, install, configuration, and metrics. Run an arbitrary Groovy script to convert JMX MBeans fetched from a remote Java application to SignalFx data points
8
8
9
-
The Splunk Distribution of OpenTelemetry Collector uses the Smart Agent receiver with the
10
-
``jmx`` monitor type to run an arbitrary Groovy script to convert JMX
11
-
MBeans fetched from a remote Java application to SignalFx data points.
12
-
This is a more flexible alternative to the
13
-
:ref:`GenericJMX <genericjmx>` monitor.
9
+
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the ``jmx`` monitor type to run an arbitrary Groovy script to convert JMX MBeans fetched from a remote Java application to SignalFx data points. This is a more flexible alternative to the :ref:`GenericJMX <genericjmx>` monitor.
14
10
15
-
.. note:: If you are instrumenting an application with the Splunk Distribution of OpenTelemetry Java, you can capture metrics with the Java agent instead of using a JMX monitor. To learn more, see :ref:`enable_automatic_metric_collection`
11
+
.. note::
12
+
13
+
To monitor JMX with the OpenTelemetry Collector using native OpenTelemetry components refer to the :ref:`jmx-receiver`.
16
14
17
-
You can use the following utility helpers in the Groovy script within
18
-
the ``util`` variable, which is set in the script's context:
15
+
If you are instrumenting an application with the Splunk Distribution of OpenTelemetry Java, you can capture metrics with the Java agent instead of using a JMX monitor. To learn more, see :ref:`enable_automatic_metric_collection`.
16
+
17
+
You can use the following utility helpers in the Groovy script within the ``util`` variable, which is set in the script's context:
19
18
20
19
- ``util.queryJMX(String objectName)``: This helper queries the
21
20
configured JMX application for the given ``objectName``, which can
:description: Use this Splunk Observability Cloud integration for the Kafka monitor. See benefits, install, configuration, and metrics
8
8
9
-
The Splunk Distribution of OpenTelemetry Collector uses the Smart Agent receiver with the
10
-
Apache Kafka monitor type to monitor Kafka instances.
9
+
The Splunk Distribution of the OpenTelemetry Collector uses the Smart Agent receiver with the Kafka monitor type to monitor Kafka instances using collectd's GenericJMX plugin.
11
10
12
-
This integration is only available on Kubernetes and Linux.
11
+
.. note:: To monitor Kafka with the OpenTelemetry Collector using native OpenTelemetry components refer to the :ref:`kafkametrics-receiver`.
13
12
14
-
This integration supports Kafka v0.8.2.x and above.
13
+
This integration has a set of built-in MBeans to pull metrics from the Kafka's JMX endpoint. For more information, see :new-page:`Kafka producer MBeans <https://github.com/signalfx/signalfx-agent/tree/main/pkg/monitors/collectd/kafka/mbeans.go>` in GitHub.
15
14
16
-
For Kafka v1.x.x and above, on top of default metrics, monitor the
17
-
following:
15
+
This integration is only available on Kubernetes and Linux, and supports Kafka v0.8.2.x and higher.
to track how long brokers wait for requests to Zookeeper to be
21
-
completed.
22
-
- Disk utilization and network metrics of the underlying host. Since
23
-
Zookeeper is an integral part of a Kafka cluster, you can monitor it
24
-
using the Zookeeper monitor.
17
+
For Kafka v1.x.x and higher monitor the following:
18
+
19
+
* ``kafka.server:type=ZooKeeperClientMetrics,name=ZooKeeperRequestLatencyMs`` to track how long brokers wait for requests to Zookeeper to be completed.
20
+
* Disk utilization and network metrics of the underlying host.
21
+
* Since Zookeeper is an integral part of a Kafka cluster, you can monitor it using the :ref:`Zookeeper integration <zookeeper>`.
25
22
26
23
Benefits
27
24
--------
@@ -38,10 +35,10 @@ Configuration
38
35
39
36
.. include:: /_includes/configuration.rst
40
37
41
-
### Example
38
+
Example
39
+
~~~~~~~~~~~~~~
42
40
43
-
To activate this integration, add the following to your Collector
44
-
configuration:
41
+
To activate this integration, add the following to your Collector configuration:
45
42
46
43
.. code-block:: yaml
47
44
@@ -61,241 +58,13 @@ section of your configuration file:
61
58
receivers: [smartagent/kafka]
62
59
63
60
See configuration examples for specific use cases that show how the
64
-
Splunk Distribution of OpenTelemetry Collector can integrate and
61
+
Splunk Distribution of the OpenTelemetry Collector can integrate and
65
62
complement existing environments.
66
63
67
64
Configuration settings
68
65
~~~~~~~~~~~~~~~~~~~~~~
69
66
70
-
The following table shows the configuration options for this monitor:
71
-
72
-
.. list-table::
73
-
:widths: 18 18 18 18
74
-
:header-rows: 1
75
-
76
-
-
77
-
78
-
- Option
79
-
- Required
80
-
- Type
81
-
- Description
82
-
-
83
-
84
-
- ``host``
85
-
- **yes**
86
-
- ``string``
87
-
- Host to connect to – JMX must be configured for remote access
88
-
and accessible from the agent
89
-
-
90
-
91
-
- ``port``
92
-
- **yes**
93
-
- ``integer``
94
-
- JMX connection port (NOT the RMI port) on the application. This
95
-
corresponds to the ``com.sun.management.jmxremote.port`` Java
96
-
property that should be set on the JVM when running the
97
-
application.
98
-
-
99
-
100
-
- ``name``
101
-
- no
102
-
- ``string``
103
-
-
104
-
-
105
-
106
-
- ``serviceName``
107
-
- no
108
-
- ``string``
109
-
- This is how the service type is identified in the Splunk
110
-
Splunk Observability Cloud UI so that you can get built-in content for
111
-
it. For custom JMX integrations, it can be set to whatever you
112
-
like.
113
-
-
114
-
115
-
- ``serviceURL``
116
-
- no
117
-
- ``string``
118
-
- The JMX connection string. This is rendered as a Go template and
119
-
has access to the other values in this config. NOTE: under
120
-
normal circumstances it is not advised to set this string
121
-
directly - setting the host and port as specified above is
- Prefixes the generated plugin instance with prefix. If a second
130
-
``instancePrefix`` is specified in a referenced MBean block,
131
-
the prefix specified in the Connection block will appear at the
132
-
beginning of the plugin instance, and the prefix specified in
133
-
the MBean block will be appended to it.
134
-
-
135
-
136
-
- ``username``
137
-
- no
138
-
- ``string``
139
-
- Username to authenticate to the server
140
-
-
141
-
142
-
- ``password``
143
-
- no
144
-
- ``string``
145
-
- User password to authenticate to the server
146
-
-
147
-
148
-
- ``customDimensions``
149
-
- no
150
-
- ``map of strings``
151
-
- Takes in key-value pairs of custom dimensions at the connection
152
-
level.
153
-
-
154
-
155
-
- ``mBeansToCollect``
156
-
- no
157
-
- ``list of strings``
158
-
- A list of the MBeans defined in ``mBeanDefinitions`` to actually
159
-
collect. If not provided, then all defined MBeans will be
160
-
collected.
161
-
-
162
-
163
-
- ``mBeansToOmit``
164
-
- no
165
-
- ``list of strings``
166
-
- A list of the MBeans to omit. This will come in handy in cases
167
-
where only a few MBeans need to be omitted from the default
168
-
list.
169
-
-
170
-
171
-
- ``mBeanDefinitions``
172
-
- no
173
-
- ``map of objects (see below)``
174
-
- Specifies how to map JMX MBean values to metrics. If using a
175
-
specific service monitor such as Cassandra, Kafka, or ActiveMQ,
176
-
they come pre-loaded with a set of mappings, and any that you
177
-
add in this option will be merged with those. To learn more, see the :new-page:`Collectd documentation <https://www.collectd.org/documentation/manpages/collectd-java.html>`.
178
-
-
179
-
180
-
- ``clusterName``
181
-
- **yes**
182
-
- ``string``
183
-
- Cluster name to which the broker belongs
184
-
185
-
The **nested** ``mBeanDefinitions`` configuration object has the
186
-
following fields:
187
-
188
-
.. list-table::
189
-
:widths: 18 18 18 18
190
-
:header-rows: 1
191
-
192
-
-
193
-
194
-
- Option
195
-
- Required
196
-
- Type
197
-
- Description
198
-
-
199
-
200
-
- ``objectName``
201
-
- no
202
-
- ``string``
203
-
- Sets the pattern used to retrieve MBeans from the MBeanServer.
204
-
If more than one MBean is returned, you should use the
205
-
``instanceFrom`` option to make the identifiers unique.
206
-
-
207
-
208
-
- ``instancePrefix``
209
-
- no
210
-
- ``string``
211
-
- Prefixes the generated plugin instance with prefix
212
-
-
213
-
214
-
- ``instanceFrom``
215
-
- no
216
-
- ``list of strings``
217
-
- The object names used by JMX to identify MBeans include
218
-
so-called “properties” which are basically key-value pairs. If
219
-
the given object name is not unique and multiple MBeans are
220
-
returned, the values of those properties usually differ. You
221
-
can use this option to build the plugin instance from the
222
-
appropriate property values. This option is optional and can be
223
-
repeated to generate the plugin instance from multiple property
224
-
values.
225
-
-
226
-
227
-
- ``values``
228
-
- no
229
-
- ``list of objects (see below)``
230
-
- The ``value`` blocks map one or more attributes of an MBean to a
231
-
value list. There must be at least one ``value`` block within
232
-
each MBean block.
233
-
-
234
-
235
-
- ``dimensions``
236
-
- no
237
-
- ``list of strings``
238
-
-
239
-
240
-
The **nested** ``values`` configuration object has the following fields:
241
-
242
-
.. list-table::
243
-
:widths: 18 18 18 18
244
-
:header-rows: 1
245
-
246
-
-
247
-
248
-
- Option
249
-
- Required
250
-
- Type
251
-
- Description
252
-
-
253
-
254
-
- ``type``
255
-
- no
256
-
- ``string``
257
-
- Sets the data set used to handle the values of the MBean
258
-
attribute
259
-
-
260
-
261
-
- ``table``
262
-
- no
263
-
- ``bool``
264
-
- Set this to ``true`` if the returned attribute is a composite
265
-
type. If set to ``true``, the keys within the composite type
266
-
are appended to the type instance. (**default:** ``false``)
267
-
-
268
-
269
-
- ``instancePrefix``
270
-
- no
271
-
- ``string``
272
-
- Works like the option of the same name directly beneath the
273
-
MBean block, but sets the type instance instead
274
-
-
275
-
276
-
- ``instanceFrom``
277
-
- no
278
-
- ``list of strings``
279
-
- Works like the option of the same name directly beneath the
280
-
MBean block, but sets the type instance instead
281
-
-
282
-
283
-
- ``attribute``
284
-
- no
285
-
- ``string``
286
-
- Sets the name of the attribute from which to read the value. You
287
-
can access the keys of composite types by using a dot to
288
-
concatenate the key name to the attribute name. For example,
289
-
“attrib0.key42”. If ``table`` is set to ``true``, path must
290
-
point to a composite type, otherwise it must point to a numeric
291
-
type.
292
-
-
293
-
294
-
- ``attributes``
295
-
- no
296
-
- ``list of strings``
297
-
- The plural form of the ``attribute`` configuration above. Used
0 commit comments