Skip to content

Commit 2381bb4

Browse files
committed
add otel limitations
1 parent 0fcdd72 commit 2381bb4

File tree

1 file changed

+36
-7
lines changed

1 file changed

+36
-7
lines changed

solutions/observability/apps/limitations.md

Lines changed: 36 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -4,15 +4,44 @@ mapped_urls:
44
- https://www.elastic.co/guide/en/serverless/current/observability-apm-agents-opentelemetry-limitations.html
55
---
66

7-
# Limitations
7+
# Limitations [apm-open-telemetry-known-limitations]
88

9-
% What needs to be done: Align serverless/stateful
109

11-
% Use migrated content from existing pages that map to this page:
10+
## OpenTelemetry traces [apm-open-telemetry-traces-limitations]
1211

13-
% - [ ] ./raw-migrated-files/observability-docs/observability/apm-open-telemetry-known-limitations.md
14-
% - [ ] ./raw-migrated-files/docs-content/serverless/observability-apm-agents-opentelemetry-limitations.md
12+
* Traces of applications using `messaging` semantics might be wrongly displayed as `transactions` in the Applications UI, while they should be considered `spans` (see issue [#7001](https://github.com/elastic/apm-server/issues/7001)).
13+
* Inability to see Stack traces in spans.
14+
* Inability in APM views to view the "Time Spent by Span Type" (see issue [#5747](https://github.com/elastic/apm-server/issues/5747)).
1515

16-
% Internal links rely on the following IDs being on this page (e.g. as a heading ID, paragraph ID, etc):
1716

18-
$$$apm-open-telemetry-tbs$$$
17+
## OpenTelemetry logs [apm-open-telemetry-logs-intake]
18+
19+
* [preview] The OpenTelemetry logs intake via Elastic is in technical preview.
20+
* The application logs data stream (`app_logs`) has dynamic mapping disabled. This means the automatic detection and mapping of new fields is disabled (see issue [#9093](https://github.com/elastic/apm-server/issues/9093)).
21+
22+
23+
## OpenTelemetry Line Protocol (OTLP) [apm-open-telemetry-otlp-limitations]
24+
25+
Elastic supports both the [OTLP/gRPC](https://opentelemetry.io/docs/specs/otlp/#otlpgrpc) and [OTLP/HTTP](https://opentelemetry.io/docs/specs/otlp/#otlphttp) protocol with ProtoBuf payload. Elastic does not yet support JSON Encoding for OTLP/HTTP.
26+
27+
28+
## OpenTelemetry Collector exporter for Elastic [apm-open-telemetry-collector-exporter]
29+
30+
The [OpenTelemetry Collector exporter for Elastic](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/v0.57.2/exporter/elasticexporter) has been deprecated and replaced by the native support of the OpenTelemetry Line Protocol in Elastic Observability (OTLP).
31+
32+
The [OpenTelemetry Collector exporter for Elastic](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/elasticsearchexporter) (which is different from the legacy exporter mentioned above) is not intended to be used with Elastic APM and Elastic Observability. Use [Elastic’s native OTLP support](../../../solutions/observability/apps/upstream-opentelemetry-collectors-language-sdks.md) instead.
33+
34+
% Statefull only for tail-based sampling?
35+
36+
## OpenTelemetry’s tail-based sampling [apm-open-telemetry-tbs]
37+
38+
Tail-based sampling allows to make sampling decisions after all spans of a trace have been completed. This allows for more powerful and informed sampling rules.
39+
40+
When using OpenTelemetry with Elastic APM, there are two different implementations available for tail-based sampling:
41+
42+
* Tail-based sampling using the [tailsamplingprocessor](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/tailsamplingprocessor) in the OpenTelemetry Collector
43+
* Native [tail-based sampling in the Elastic APM backend](../../../solutions/observability/apps/transaction-sampling.md#apm-tail-based-sampling)
44+
45+
Using the [tailsamplingprocessor](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/tailsamplingprocessor) in the OpenTelemetry Collector comes with an important limitation. Elastic’s APM backend calculates span and transaction metrics based on the incoming span events. These metrics are accurate for 100% sampling scenarios. In scenarios with probabilistic sampling, Elastic’s APM backend is being informed about the sampling rate of spans and can extrapolate throughput metrics based on the incoming, partial data. However, with tail-based sampling there’s no clear probability for sampling decisions as the rules can be more complex and the OpenTelemetry Collector does not provide sampling probability information to the Elastic backend that could be used for extrapolation of data. Therefore, there’s no way for Elastic APM to properly extrapolate throughput and count metrics that are derived from span events that have been tail-based sampled in the OpenTelemetry Collector. In these scenarios, derived throughput and count metrics are likely to be inaccurate.
46+
47+
Therefore, we recommend using Elastic’s native tail-based sampling when integrating with OpenTelemetry.

0 commit comments

Comments
 (0)