does txt2img API support parallel ?

[ykhasia]

does txt2img API support parallel ? which means when the txt2img api requested 3 times at once, the stable difussion could generate 3 images parallelly, not in sequence.

[ykhasia]

Any solutions ?

[Kilvoctu]

The Web UI itself can only perform one task at a time, as far as I know.
If you're running multiple Web UI instances then hypothetically it should be possible to run concurrent tasks via API through your front end application 🤔

[ykhasia]

Its a bright work around solution.. Haha...
Maybe I have to try another way: Study the stable-diffusion source code and modify it to support real concurrent tasks ?
or Study the stable-diffusion-webui source code and modify it to support real concurrent tasks ?
Do you know how to get it ? thanks in advance.. :)

[Kilvoctu]

Unfortunately, I only deal with the API and anything regarding the API.
Auto's web ui is mostly incomprehensible code to me lol. The Web UI does have a built-in queuing system, you can start by looking there

[ykhasia]

OK, I got. Thank you.

[uatdark]

Have u solved this problem? I‘m facing the same challenges.

[ykhasia]

need to change the source code 在 2023-03-03 17:42:22，uatdark ***@***.***> 写道： Have u solved this problem? I‘m facing the same challenges. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[ykhasia]

remove the code such as "with self.queue_lock" then it could be parallel.

…

-- 发自我的网易邮箱手机智能版 在 2023-03-03 17:42:22，uatdark ***@***.***> 写道： Have u solved this problem? I‘m facing the same challenges. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

[castaneai]

Hi, I made a patch that changed queue_lock to Semaphore.
I can now call the API in parallel in my environment. You can try it too if you want.

#10421

[DanBurkhardt]

Hi, I made a patch that changed queue_lock to Semaphore. I can now call the API in parallel in my environment. You can try it too if you want.

#10421

Seems they aren't merging it due to some concerns around other plugins that use multiple threads. Do you have a fork?