Is it possible to optionnaly add $ cost in Proxy response json, in addition to token usage ?

[olad32]

proxy response could be :

{
...
"usage": {
    "completion_tokens": 163,
    "prompt_tokens": 14684,
    "total_tokens": 14847,
    "cost": 1.123 <-- new
   }
}

This may be controlled by a new proxy config parameter

[ishaan-jaff]

@olad32 we could return it in the response headers @olad32. would that work ?

[olad32]

Yes thats also ok. Else it would have break openai response json format ? Le 3 juin 2024 16:51:07 GMT+02:00, Ishaan Jaff ***@***.***> a écrit :

…

@olad32 we could return it in the response headers @olad32. would that work ? -- Reply to this email directly or view it on GitHub: #3982 (comment) You are receiving this because you were mentioned. Message ID: ***@***.***>

[krrishdholakia]

Curious, how would you use this?

[olad32]

hi, this will allows us to display cost usage per request to the end user

[krrishdholakia]

got it - we can do this, when do you need this by?

[olad32]

hello, we need this as soon as possible

[krrishdholakia]

got it - will pick this up today.

Can we setup a direct support channel? @olad32

Can do linkedin/discord/slack

will help prioritize any issues your team has