Can I process two requests of text2image together at the same time? (concurrency or multithreading) #10148
hosein-moayedi
started this conversation in
General
Replies: 1 comment
-
Is't the situation that service can only hold one model in the same time? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Are there any way to handle each request in different threads for processing and generating images parallelly (concurrency or multithreading) to speed up responding to each request?
At this time if user 1 sends a request to the server for making a new image and also at the same time user 2 makes a new request to the server to generate his image, the server will wait until finish the request of user 1 and then it will start to process the request of user 2.
Can I process these requests together at the same time?
Beta Was this translation helpful? Give feedback.
All reactions