Skip to content

Commit e9cd68d

Browse files
committed
Fix MCP trace docs: clarify 100% sampling, remove unsupported exports
Remove Grafana and Datadog export instructions since one-span-per-topic format is incompatible with batch-based platform requirements.
1 parent d91266b commit e9cd68d

File tree

1 file changed

+3
-57
lines changed

1 file changed

+3
-57
lines changed

modules/ai-agents/pages/mcp/remote/monitor-activity.adoc

Lines changed: 3 additions & 57 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ You must have an existing MCP server. If you do not have one, see xref:ai-agents
99

1010
== OpenTelemetry traces topic
1111

12-
When you create an MCP server, Redpanda automatically creates the `redpanda.otel_traces` topic in your cluster. This topic stores OpenTelemetry span data in JSON format, following the https://opentelemetry.io/docs/specs/otel/protocol/[OpenTelemetry Protocol (OTLP)^] specification.
12+
When you create an MCP server, Redpanda automatically creates the `redpanda.otel_traces` topic in your cluster. This topic stores OpenTelemetry span data in JSON format with 100% sampling rate (also known as an execution log), following the https://opentelemetry.io/docs/specs/otel/protocol/[OpenTelemetry Protocol (OTLP)^] specification.
1313

1414
A Protobuf schema named `redpanda.otel_traces-value` is also automatically registered with the topic, enabling clients to deserialize trace data correctly.
1515

@@ -47,7 +47,6 @@ Traces provide:
4747
Traces are not:
4848

4949
* Immutable audit records for compliance purposes
50-
* Guaranteed to capture every action (traces can be sampled or dropped under load)
5150
* Designed for "who did what" accountability tracking
5251

5352
== Consume trace data
@@ -279,60 +278,7 @@ Link MCP server activity to downstream effects:
279278

280279
== Integration with observability platforms
281280

282-
The `redpanda.otel_traces` topic uses standard OpenTelemetry format, making it compatible with popular observability platforms.
281+
The `redpanda.otel_traces` topic stores trace data in OpenTelemetry format. Direct export to platforms like Grafana Cloud and Datadog is not supported due to format compatibility limitations. Redpanda produces one span per topic message, whereas these platforms expect traces in batch format.
283282

284-
=== Grafana Cloud
285-
286-
Export traces to Grafana Cloud's managed Tempo service:
287-
288-
. Get your Grafana Cloud OTLP endpoint and credentials:
289-
+
290-
* OTLP endpoint: `https://otlp-gateway-{region}.grafana.net/otlp/v1/traces`
291-
* Instance ID (from your Grafana Cloud portal)
292-
* API token or Access Policy token
293-
. Create a Redpanda Connect pipeline that consumes from `redpanda.otel_traces`.
294-
. Send traces to Grafana Cloud with authentication.
295-
. View and query traces in your Grafana Cloud instance.
296-
297-
Example pipeline configuration:
298-
299-
[,yaml]
300-
----
301-
input:
302-
kafka:
303-
addresses: [ "${REDPANDA_BROKERS}" ]
304-
topics: [ "redpanda.otel_traces" ]
305-
consumer_group: "grafana-cloud-exporter"
306-
307-
pipeline:
308-
processors:
309-
- mapping: |
310-
root = this
311-
312-
output:
313-
http_client:
314-
url: "https://otlp-gateway-prod-us-central-0.grafana.net/otlp/v1/traces"
315-
verb: POST
316-
headers:
317-
Content-Type: "application/json"
318-
Authorization: "Basic ${secrets.GRAFANA_CLOUD_INSTANCE_ID}:${secrets.GRAFANA_CLOUD_API_TOKEN}"
319-
basic_auth:
320-
enabled: true
321-
username: "${secrets.GRAFANA_CLOUD_INSTANCE_ID}"
322-
password: "${secrets.GRAFANA_CLOUD_API_TOKEN}"
323-
----
324-
325-
[TIP]
326-
====
327-
Store your Grafana Cloud credentials in the xref:develop:connect/configuration/secret-management.adoc[Secrets Store] and reference them using `${secrets.GRAFANA_CLOUD_INSTANCE_ID}` and `${secrets.GRAFANA_CLOUD_API_TOKEN}`.
328-
====
329-
330-
=== Datadog
331-
332-
Forward traces to Datadog APM:
333-
334-
. Use Datadog Agent with OpenTelemetry support.
335-
. Configure a pipeline to consume `redpanda.otel_traces`.
336-
. Convert to Datadog trace format.
337-
. View in Datadog APM with full correlation.
283+
You can consume traces directly from the `redpanda.otel_traces` topic using any Kafka-compatible consumer for custom analysis and processing.
338284

0 commit comments

Comments
 (0)