OTEL generative AI events

[verdie-g]

I noticed that the OTEL chat client does not emit the generative AI events but SemanticKernel does.

Technologies such as langfuse rely on these events.

I feel like these events should also be available in MEAI. Wdyt?

[verdie-g]

I understand that the events were actually removed from the OTEL spec.

Maybe we could support gen_ai.input.messages/gen_ai.output.messages instead?

[stephentoub]

It used to emit them as data attached to spans, but the otel spec changed back in October-ish, at which point #5532 updated the implementation to conform accordingly, with the cited data being emitted using the ILogger injected by the otel components. The link you cite (https://opentelemetry.io/docs/specs/semconv/gen-ai/gen-ai-events) is for the newly-released 1.37 version of the standard convention, which includes open-telemetry/semantic-conventions#2179 that was just merged two weeks ago and which now reverts to allowing this data to be included on the spans. OpenTelemetryChatClient and friends will be updated to this version of the spec in the near future.