Controlnet is not work with WEBUI Forge

[Dohye111]

I installed WEB UI - FORGE on my computer and attempted to generate an image using Controlnet - Openpose functionality, but Controlnet did not work at all. Judging from the fact that only the picture and skeleton are generated, it seems that Controlnet is working, but the skeleton is not being reflected in the image.

The Controlnet Model I used is from the models at this link: , and since these did not work, I also tried models from this link: , but still the skeletons of Controlnet are not being reflected in my image.

[mrsunshine74]

I have the same problem if you solve it please post the solution thank you!

[dog0311]

In my terminal window it doesn't say it's not working it just says it's not enabled. The actual termonolgy it uses is "requires "sd-webui-controlnet" which is disabled". I have installed it, but I think I screwed up by installing something before installing "controlnet" but I got an error saying I needed to install control net which I did right after that, But I can't figure out how to ENABLE it (ControlNet), I'm not setting some flag somewhere. Maybe it's time to try some of my old debug tricks and see what I can find, worst case, reinstall. Don't know if that helps anyone.

[UnconnectedBedna]

Enable it then, controlnet does NOT need to be installed, it is integrated in forge, check extensions page and make sure sd_forge_controlnet is enabled. sd_webui_controlnet is not for forge btw so get rid of that.
You have to download models for the different controlnets though.

[LucianoDaluz]

Same here

[Iter8tion]

I was also having issues getting Openpose to work. For me, the "preprocessor" button would not work when I was attempting to do "Allow Preview".
After two days of trying to troubleshoot things and reinstalling twice, I somehow figured out it was my extensions causing an issue. Meaning that I believed one or more of my extensions were breaking my ability to use OpenPose in ControlNet.
I did get it to work again.
What I did was disable all of my extra Extensions (leave the default /built-in Forge ones on).
Then, in groups of 5 extensions....I turned them on, went back to Controlnet, and tried an openpose preview test. If the Preprocessor button worked and generated a preview in the preview window, then I assumed that those 5 extensions were not creating an issue.
I then went down my entire extension list, adding in 5 extensions, testing, and repeating. If it suddenly did not function again, then I went back and disabled the last 5 extensions I added, then added each back in one at a time till I determined which one of the 5 was throwing an error.
Once I made it through my list of extensions, it turned out 3 of them affected the preprocessor button (sd-webui-segment-anything, sd-webui-tabs-extension, and stable-diffusion-webui-aesthetic-image-scorer). Once those 3 were disabled, I was able to use Controlnet with OpenPose again (SD1.5 and SDXL).
This fixed my particular issue. It may or may not be an avenue to fix your issue, too. Good Luck.

[pflky]

Controlnet is absolutely wonky in Forge. I get errors for seemingly no reason all the time. The worst part is forge doesn't even allow you to install the default controlnet, which is far more updated. Since stable diffusion is basically nothing without controlnet, this is an issue that makes any speed ups forge gives, pointless....because if you can't use controlnet, you really can't use stable diffusion in general. I've wasted more time trying to get around errors in forge than the amount of extra generation time it would have taken in regular webui.

[ArnorWing]

Yes, please allow install of regular CN

[vixenius]

Yup, I'm getting errors as well and regular CN just wont enable no matter what i do. Imma stick to a1111 for now since i use cn 99% of the time. p.s. built-in cn wont even match preprocessors and models as it should, its pain in the azz. :(

[nuclear87]

Where is the developer >?
i know you already did something great and ppl enjoyed it , dont ruin it as you ignore thier complaining about existing problems !

[UmbralMoth]

So to anyone else also looking to use regular ControlNet instead of built-in one. You can just remove regular ControlNet from being always disabled in config.py in modules_forge folder inside the WebUI Forge's main folder.
Just don't forget to disable all the built-in extensions related to built-in ControlNet in extensions!
Edit: Though fair warning, even though it'll enable it, it isn't really intended to be used with Forge, so don't expect it to work, at all.

[foychermin]

has anyone come up with a fix for this that doesnt involve diving into py files.........i have no idea whats going on in those files or how they work.

[mikeharper31]

Similar problem here. Can see the list of controlnet pre-processors, but no models at all...

[changeyi111111]

I have encountered the same problem as you. I have tried many methods these days, but they do not work. Have you solved it
By the way I'm running on the M2 chip on a mac

[mikeharper31]

No, still haven't worked out what the problem is. Tried various things. Posting here was my last hope :)

[anonymous-person]

I had that problem too. The control net models moved from:
extensions/sd-webui-controlnet/models
to
models/ControlNet
Then they will show up in the model pick list.

But I can only get ControlNet to work if I use a SD1.x model, not Flux.

[maraan666]

As mentioned elsewhere on this forum, the rewrite of ControlNet has been delayed. Work will begin around 30th October. Just be patient.

[Syeph0n]

Lol finally someone answers with what I was suspecting. Good to know a rewrite is coming! I figured it was something that had been pushed back for a long time.

[Ultimum007]

Any news on this issue?

[CCpt5]

Any news on this issue?

Latest date for rewrite of Controlnet (fixes/Flux I assume) is November 20th - see #932 (comment)

I can only imagine the kind of work/studies Forge developer lllyasviel does IRL so I'm sure having specific dates like that set are due to priorities. Many of us are waiitng - it'll be cool when it's back up to date.

[espritdautomne]

this fork is just bad and buggy. I just gave it another chance and still, lot of new features, flux support, but man, everything else is broken, no animatediff fix, controlnet is just broken and wont work, 3 out of 4 plugins wont install correctly. This is just a nightmare to use.

[shirecoding]

open pose doesnt seem to be working for me

[UnconnectedBedna]

Everybody in here should know you most likely have to manually download the models for controlnet, and SD models wont work for SDXL and vice versa.

I have been using models from here.
https://huggingface.co/lllyasviel/ControlNet-v1-1/tree/main
https://huggingface.co/lllyasviel/sd_control_collection/tree/main

Are there better models? Probably, but I have used models from those repos in the past wo problems.
But you have to select the correct model in the dropdown after downloading them. sd model for sd1.5, and SDXL model for SDXL. (use refresh button if they don't appear after placing them in the correct location = models/ControlNet)

[DanielCarmel]

Any update about this?

[ArnorWing]

There is more activity on this issue on the Reforge fork.
Still not working though