requesting for multiple specific GPUs

[pfk-beta]

Hello,

I have a case to benchmark some models using multiple GPUs. But GPUs are sometimes connected in different ways. So i'm running benchmarks in potentially different environments. The problem is, I want to dynamically request few GPUs (2 or 4), but specific ids. Let's say I want first 4 (or by specifying UUID), instead of getting random. I'm pretty sure it is not implemented, and it would be hard to have that. I see many corner cases:

• I'm requesting 1st, 2nd, 3rd and 4th GPU. My pod is running on normal prioriry. Then I need to wait until all these specific GPUs are free.
• I'm requesting 1st, 2nd, 3rd and 4th GPU. My pod is running on high priority. Then all other Pods with these specific GPUs are dispossessed

I see something like this:

      resources:
        requests:
          nvidia.com/gpu: "GPU-e19cc35d-55a8-6921-0019-38516355bb7f,GPU-69cf68f9-b68e-e6ef-4e76-c0b3e39342d7,GPU-7dc27b97-49ba-3d03-546d-8e8c98dd8778,GPU-acb794b6-1964-a9fd-f1ff-5429340d8509"