You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Depending on the LLM provider you choose, the following table shows which source you can use and which type of data -- log or metrics -- you can collect.
|[AWS Bedrock][int-bedrock]|[AWS CloudWatch Logs][impl-bedrock]| ✅ | ✅ | GA |
28
+
|[Azure OpenAI][int-azure]|[Azure Monitor and Event Hubs][impl-azure]| ✅ | ✅ | GA |
29
+
|[GCP Vertex AI][int-vertexai]|[GCP Cloud Monitoring][impl-vertexai]| ✅ | 🚧 | GA, we are not able to collect meaningful information for request/response from logs due to dynamic generation, GCP are aware of this issue, not ETA yet |
|[OpenTelemetry][int-wip-otel]| OTLP | 🚧 | 🚧 | This would support Elastic extensions of otel's GenAI semantic conventions |
32
+
33
+
23
34
## APM tracing for OpenAI models (via instrumentation)
24
35
25
36
Elastic offers specialized OpenTelemetry Protocol (OTLP) tracing for applications leveraging OpeAI models hosted on OpenAI, Azure, and Amazon Bedrock, providing a detailed view of request flows. This tracing capability captures critical insights, including the specific models used, request duration, errors encountered, token consumption per request, and the interaction between prompts and responses. Ideal for troubleshooting, APM tracing allows you to find exactly where the issue is happening with precision and efficiency in your OpenAI-powered application.
@@ -30,6 +41,19 @@ You can instrument the application with one of the following OpenTelemetry API:
| Cohere| Python|[cohere][wip-otel-cohere-py]| 🚧 | 🚧 | 🚧 | 🚧 | Owner: Leighton from Microsoft |
55
+
| Google Cloud AI Platform | Python |[google-cloud-aiplatform][otel-vertexai-py]| ✅ | 🚧| 🚧| 🚧 | Vertex (not Gemini); Clashes with OpenLLMetry package |
56
+
33
57
## Getting started
34
58
35
59
Check these instructions on how to setup and collect OpenTelemetry data for your LLM applications [create a link to https://github.com/elastic/opentelemetry/pull/100/files#diff-965570d21670c0ee4bba4b303960e5fe83b285f66b001ff8f31f0413f65a9d47 once the content is finalized and merged]
0 commit comments