Adapter name photomaker already in use in the Unet - please select a new adapter

[GraftingRayman]

I get this error when running it the 2nd time, 1st time it is fine, have to restart comfyui to get it working again for 1 image

[GraftingRayman]

If i run another workflow and come back to this, it works fine, looks like the unet model is not unloaded?