2024-02-28: OpenTelemetry instrumentation for OpenAI calls
The primary change in this release is the integration of the opentelemetry-instrumentation-openai package for tracing OpenAI calls. You should now see traces for all calls made by the OpenAI SDK in Azure Monitor.
We are still using the HTTPX instrumentation package as well, which should also trace the calls since OpenAI SDK uses HTTPX for HTTP calls behind the scenes, but they recently made a change that's resulting in inconsistent HTTPX tracing. You may sometimes see multiple traces for same call, one from the HTTPX instrumentor and one from the new OpenAI instrumentor.
What's Changed
- Implement better LLM tracing with llmetry OpenAI instrumentation by @tonybaloney in #1319
- Improve PR template to reference tutorial changes and contributing checklist by @pamelafox in #1335
- Update launch.json with python backend path by @pamelafox in #1022
- Update app diagram by @pamelafox in #1338
- Show users a special message for context length errors by @pamelafox in #1337
Full Changelog: 2024-02-27...2024-02-28