Extend OpenAITelemetryPluginReport with cached tokens information #1414

Open

Labels

enhancementgood first issuehelp wanted

waldekmastykarz

opened

Extend OpenAITelemetryPluginReport with cached tokens information. The information is available in the response.body.usage.prompt_tokens_details.cached_tokens property.

Metadata

Assignees

No one assigned

Labels

enhancementgood first issuehelp wanted

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests