How to use different GPUs for text generation and Image generation? (Vulkan)

[stduhpf]

I have 2 discrete GPUs in my system:

  Vulkan0: AMD Radeon RX 6800 (16368 MiB, 16368 MiB free)
  Vulkan1: AMD Radeon RX 5700 XT (8176 MiB, 8176 MiB free)

Whenever I try loading both a LLM and a sd model with koboldcpp, both models get loaded on the same GPU. I would like to have LLM running on the 6800 and sd running on the 5700 XT, but I can't figure out if this is even possible.
Only solution I found was to have two instances of koboldcpp, one for text only and the other for image generation only.

[LostRuins]

That is indeed the best solution - right now the image gen always uses the first dGPU in a multigpu setup.

[brknsoul]

Another option would be to spin up an external SD UI in API mode (Like Forge-ZLUDA) running on the other GPU.