API check returns the whole string every time #932
Unanswered
JimmyInsane
asked this question in
Q&A
Replies: 1 comment
-
Yes, this is intended. The polling is intended to check progress on an ongoing sync generate. For SSE streaming, you can use the /api/extra/generate/stream instead. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm currently writing a small python script to access the API.
Currently on one thread I start the generation while the other periodically checks if there is new content.
I'm using a post on this localhost:5001/api/extra/generate/check
But this always returns the whole current string and not just the part that hasn't been polled yet.
For example the full output string would be "Hey there, I am your personal AI"
The result would be:
"Hey there,"
"Hey there, I am your"
"Hey there, I am your personal AI"
Which I guess would be fine if i just update a div in a webpage but for a console application i have to carriage return every time I get a message.
Is this intended?
Beta Was this translation helpful? Give feedback.
All reactions