Allocate a batch of images for mulltiple GPUs

[Imagium719]

Maybe it's difficult to process one image with multiple GPUs, but why not allocate independent tasks(with same prompts) to them? It's useful when generating a large batch of images. I just don't wanna run many SD and browser processes.

[vladmandic]

webui does not do per-gpu scheduling - and honestly, no application should - that should be up to lower levels, e.g. torch.
now, how do you get torch to fully utilize available hardware?
did you configure accelerate?
and are you running with sufficiently large batch size so that even matters (batch count is a sequential operation, batch size is parallel).

[Imagium719]

I'm not talking about that low-level "batch". I mean generating many similar images at once, so that I can choose the best one. I think this is what webui can do.

[vladmandic]

Adding that to main WebUI would overload it for a very tiny use case, but it can be made as an extension if anyone is willing to write it.