Multi-GPU support?

[mailani19]

Hello folks. I'm wondering if there are any plans or if there currently is support for multiple GPUs.
I'm considering setting up a small rack of GPUs but from what I've seen stated this particular version of SD isn't able to utilize multiple GPUs unless you run a separate instance of it per GPU. Which has its uses but then you can't really make full use of say.. 120GBof VRAM and would be stuck using 10 instances of 12GB each.

If I'm wrong and this is doable could someone explain how?

[Nacurutu]

This question was already answered her:

#1621

👍🏻

[mailani19]

My apologies. I looked through the discussions and missed it I guess. Thanks.

[Nacurutu]

no worries, and more than welcome! 👍🏻

[ChongmingDu]

Very much looking forward to this feature 🚀

[doem97]

Oh. 2023 already. People are still using single card inference, and need to copy the folder for N times for parallel running ;D