don't get the --stream option #109
Unanswered
maddes8cht
asked this question in
Q&A
Replies: 1 comment
-
It does but you need to use the streaming url for it to work. Try this: |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
In the Oobabooga webinterface i can see the Ai's Answer "streaming in" while it is being generated. In Koboldcpp, even on the console i just see a counter of the generated tokens, then - boom - the answer is showed up as a whole.
Which then makes sense to reduce the Answers length to 80 Tokens, but i would like to have it the way it is in Oobabooga.
I was hoping the
--stream
option would do this, but it doesn't - what is it meant for, if not this?Is there a way to get the kind of
stream
i was looking for?Beta Was this translation helpful? Give feedback.
All reactions