Is batching prompts possible in Kobold? #739
Answered
by
LostRuins
alexchatwin
asked this question in
Q&A
-
|
(by that I mean - can I sumit multiple prompts at once, via the API, and get a benefit to processing time) |
Beta Was this translation helpful? Give feedback.
Answered by
LostRuins
Mar 10, 2024
Replies: 1 comment 1 reply
-
|
No, but the API has a multiuser mode which can queue multiple requests and process them in sequence. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thanks for the quick reply. And for the excellent software- I'll give that a try 👍 |
Beta Was this translation helpful? Give feedback.
Answer selected by
alexchatwin
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
No, but the API has a multiuser mode which can queue multiple requests and process them in sequence.