[Feature request] ostris / Flex.2-preview. Open Source 8B parameter T2I Diffusion Model with universal control and inpainting support built in.

[nitinmukesh]

It was not a bug so removed unnecessary information.

The next version of Flex.1-alpha is released.
https://huggingface.co/ostris/Flex.2-preview

The solution is provided using custom pipeline by author of model which is working. Please refer the Model card for code.

However, it will be good to have this integrated in diffusers as core function.
In future other variants of Flux schnell may appear with similar functionality.

[a-r-r-o-w]

Really cool model but this looks like it'll require a new pipeline implementation to accept canny/depth/openpose and other inputs for concatenation with latents

[nitinmukesh]

Thanks for the info, @a-r-r-o-w .

Please could you add New pipeline/ Community contribution tags, if someone wants to give it a go.

[a-r-r-o-w]

@nitinmukesh Any reason for closing this FR? We would love to support it once someone on the team has the bandwidth, but until then I think this might be nice for good first contributions, no?

[nitinmukesh]

@a-r-r-o-w

My apologies, somehow my comment was not added while closing the issue.

It is working. The author provided custom_pipeline for diffusers. I tested it. It's in Model card.
https://huggingface.co/ostris/Flex.2-preview

[a-r-r-o-w]

Oh, that's amazing! But it uses a remote pipeline, and I think it'll be an impactful model to support. Is it okay to still keep this issue open so that we can track natively adding support for it?

[nitinmukesh]

Oh absolutely. I reopened it.