How to keep the characters in the original picture and only change the color of clothes using the picture-generating picture api

[prog-ape]

How to keep the characters in the original picture and only change the color of clothes using the picture-generating picture api

[samjwu]

Method 1:
Use the inpainting feature. Paint over the character's clothes only while avoiding their face, then modify the prompt to specify the type and color of clothing that you want.
There are several inpainting tutorials that can be found using Google search, but this is a relatively short and simple tutorial that should cover the basics needed for this task: https://stable-diffusion-art.com/inpainting_basics/

Method 2:
If you are familiar with image editing tools (Photoshop, GIMP, or Krita for example), you can "prepare" the image by selecting the clothing using the feather selection tool, change the color, and then put it through img2img using the same prompt (or a modified one with the correct clothing color specified) to get a better render and easily correct any errors made during the color change process.

[w-e-w]

iirc there are also some extension that can generate segmentation maps
don't know if that have implemented API endpoints

[NextDiffusion]

Feel free to check out my tutorial about changing outfits with stable diffusion and ControlNet (OpenPose).

Written Tutorial can be found here: https://www.nextdiffusion.ai/tutorials/change-character-outfit-with-stable-diffusion-inpaint-and-controlnet

[sudip550]

What if we want to add specific custom clothes

[viebrix]

@sudip550 custom clothes which stable diffusion knows already? Or ist this a new creations you cannot describe in a prompt, so that it is generated correctly?

[sudip550]

Means... We'll provide clothes image, then it will generate image in which person will wear thus clothes

[viebrix]

One possibility is with inpainting like i mentioned in the other discussion thread. But there should the clothes located in the image like a person is already wearing it. Then you inpaint a person into this clothes.

Another possibility could be the t2i adapters in controllnet:
https://stable-diffusion-art.com/controlnet/#Clip_vision_style_T2I_adapter
Mostly they are used the other way round. You define a face / hair style and prompt the person into other clothes or in another background. I never tried it, and I don't know if you can also match the style of clothes in a new picture.

If those clothes not own designed, maybe there already exists some lora. Then you could download these from Civitai and use them in your generation.
https://stable-diffusion-art.com/lora/

But the best way (or if the clothes originals by yourself) would be to create a lora with your clothes. But this way is the most expansive method. You need a lot of images of your clothes and train those image in a model or better said an extension to a model. You need lot of time and gpu power.
https://stable-diffusion-art.com/train-lora/

[2thecurve]

is it possible to inpaint a logo on an outfit and create a logo of your choice to be replaced it. So say I have a Nike symbol I inpaint and I want a logo of my own choosing on it instead,