Display token usage for OpenAIAssistantRunnable traces in LangSmith

[christos-bsq]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

OpenAIAssistantRunnable traces in LangSmith don't have information about tokens.

OpenAI now supports the usage of the Assistant API!
Related documentation here https://platform.openai.com/docs/api-reference/runs/object#runs/object-usage

Motivation

Without this improvement, it's very hard to track usage and costs related to OpenAI Assistant API.

Also, it's a poor UX for LangSmith.

Proposal (If applicable)

No response

[franciscoabenza]

Waiting for a solution too

[thousandoaks]

I agree, this is an important feature for those using OpenAI based assistants

[franciscoabenza]

I can't understand how is that not done already.. all the necessary info is part of the api response, isn't?