[Enhancement]: Cost tracking across different endpoints.

[alextheradu]

What features would you like to see added?

Ability to add pricing for API models such as o3, which are expensive so you can track how much you spend. This would be useful for people, such as myself, who don't put too much money into credits and want to squeeze every last dollar out of it using different APIs.

More details

Maybe something like the picture linked.

Which components are impacted by your request?

General

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

You can use the balance system to help manage costs:

https://www.librechat.ai/docs/configuration/token_usage#balance-configuration

[shawly]

But can we define a balance per endpoint?
If I enable balance like described in the docs, it tracks total token usage. So for example I don't wanna track my Ollama endpoint since its local compute power. But I do wanna track all apis that I actually have to buy credits for, separately so I see how much tokens a user has actually spent on a specific api. My LibreChat instance is private so I only share it with my partner but I don't know how many tokens have been spent by whom and I'd like to make it fair.