How does the Tokens used/max indicator at the bottom right of the GUI reflect the true number of tokens used?

[TFWol]

It's confusing when I see this in the GUI:

when the console shows me this:

Processing Prompt [BLAS] (44 / 44 tokens)
Generating (343 / 2048 tokens)
(EOS token triggered! ID:2)
[05:35:18] CtxLimit:392/8192, Amt:343/2048, Init:0.00s, Process:0.01s (7333.33T/s), Generate:7.10s (48.31T/s), Total:7.11s

[LostRuins]

Ah yeah, that's the token estimator. It uses a character counter so it's not very accurate (it's estimating by characters instead)

[TFWol]

Oh, got it. Thanks!
That second number though is waaay off 😆

[TFWol]

Question: Is this the same number you get when asking the koboldcpp api?

[LostRuins]

Nope. This is a pure browser only estimation. It's very likely to be wrong.

[TFWol]

Sweet, thanks for the info.