EOS token

[lobsterchan27]

is there a way to set the server to stop on the eos but return it as well? i'd like to be able to tell easily when it hits a token and not the max length. im trying to use tokenizer/or count the chunks but it doesn't always lineup with kobold

[LostRuins]

You can determine the stop reason by checking the /api/extra/perf/ endpoint