New way of editing images with text instructions

[user2734283]

https://github.com/timothybrooks/instruct-pix2pix

This looks very promising. I would love to see it integrated but I dont know how much work it is. They trained a model (separate from SD) on these instructions, but I cant say much about the technical details and what is needed to integrate it

[Alchete]

There's some really cool stuff coming very soon. Check out this one too: https://github.com/gligen/GLIGEN

It lets you compose the image components based on keywords and a quick sketch. Click on the demo to try it.