In SSE, How can i get the details's usage in prompt(prompt_tokens, completion_tokens, total_tokens)

[AutumnWhj]

When i set onProgress function in ChatGPTClient, ,example:

But，i can't get the details's usage in this prompt

so, can everyone help me?

[waylaidwanderer]

OpenAI doesn't provide that information in streaming mode. You have to keep track of it yourself some other way.

[AutumnWhj]

May be i can use getTokenCountForMessage to count it , but it may not be accurate enough, so it's better to rely on the usage returned by OpenAI?

[waylaidwanderer]

Yeah for counting input that's the best option. I think for the output you can just count how many times onProgress is called with a token.