Token count discrepancy: UI shows 70.4k tokens while API reports 257661 tokens

[KJ7LNW]

Which version of the app are you using?

v3.10.2

Which API Provider are you using?

OpenRouter

Which Model are you using?

sonnet-3.7-thinking

What happened?

There's a severe discrepancy between the token count displayed in the UI and what's being sent to the API. The UI shows only 70.4k tokens out of a 200k limit, but the API is receiving a request with 257661 tokens - more than 3.5 times what's displayed in the UI.

The API returned this error:
"This endpoint's maximum context length is 200000 tokens. However, you requested about 257661 tokens (129661 of text input, 128000 in the output). Please reduce the length of either your prompt or max_tokens parameter or transform to compress your prompt automatically."

This makes it impossible to gauge whether a prompt will succeed or fail based on the UI's token counter.

Steps to reproduce

1. Created a task with a large amount of text/code
2. Observed the UI showing context window usage as 70.4k/200.0k tokens
3. Submitted the request
4. Received an error about exceeding context length (257661 tokens requested vs 200000 maximum)

Relevant API REQUEST output

Additional context

OpenRouter Transforms are OFF, but this should not matter with respect to internal token counting:

Screenshot:

[mrubens]

I think the usage polling for OpenRouter may be failing sometimes. But, they just released a new way to get usage info: #1905

[jazir555]

this happens on deepseek as well

[hannesrudolph]

@mrubens this has been fixed as of latest update?

[jazir555]

@mrubens this has been fixed as of latest update?

I'm still getting a token discrepancy issue with DeepSeek. The Token count just bounces around randomly.

[hannesrudolph]

@mrubens this has been fixed as of latest update?

I'm still getting a token discrepancy issue with DeepSeek. The Token count just bounces around randomly.

This issue specifically relates to Open Router.

[jazir555]

@mrubens this has been fixed as of latest update?

I'm still getting a token discrepancy issue with DeepSeek. The Token count just bounces around randomly.

This issue specifically relates to Open Router.

I'm using the official DeepSeek API, not OpenRouter.

[hannesrudolph]

@mrubens this has been fixed as of latest update?

I'm still getting a token discrepancy issue with DeepSeek. The Token count just bounces around randomly.

This issue specifically relates to Open Router.

I'm using the official DeepSeek API, not OpenRouter.

And you are commenting on an issue which is very specifically about Open Router with a already scoped out cause which could not be the cause of your issue. Similar symptoms, different cause. Please create a new issue.

[jazir555]

@mrubens this has been fixed as of latest update?

I'm still getting a token discrepancy issue with DeepSeek. The Token count just bounces around randomly.

This issue specifically relates to Open Router.

I'm using the official DeepSeek API, not OpenRouter.

And you are commenting on an issue which is very specifically about Open Router with a already scoped out cause which could not be the cause of your issue. Similar symptoms, different cause. Please create a new issue.

Will do

[KJ7LNW]

openrouter still seems to be inconsistent: I have had it run out of tokens even though the bar seems quite small on 3.10.5

[SannidhyaSah]

i'll take this up