Skip to content

Fix usage in ChatResponse metadata when tool calling is used #1843

@ilayaperumalg

Description

@ilayaperumalg

When the tool calling is used, the Chat Model's Chat response metadata doesn't accumulate the usage metrics (accumulated prompt, chat completion and total tokens) from all the Chat responses involved - including the tool calling.

This epic addresses the fix needed for all the supported models.

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingepicinvalidThis doesn't seem right

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions