How to load multiple checkpoints to gpu

[HaozhouPang]

Hello,

I'm currently using sd webui with --api flag as an server, I need to play around with multiple checkpoints and compare their outputs, each time I switch to a new model, it takes long time (~ 15s) to reload the model to gpu. In my case I have a gpu with large memory, is it possible to load all checkpoints into gpu at once?

[w-e-w]

multiple checkpoints
load all checkpoints into gpu at once

"all" you say, hmmm
I don't know how many total checkpoints you have so I'm going to use 100 as it is a "reasonable" number
I kind of doubt that you have a large enough GPU to fit 100 of them all at once

it takes long time (~ 15s)

consider using an fast SSD, a sd 1.5 model loads around 2.5s of me