Deforum ⊗ ControlNet — how to handle?

[kabachuha]

Should we integrate it similarly to video input, as a sequence of input images? Or pass various filters on the input video?

Pass your ideas, experience

[andyxr]

It would be good to see it act on a video. That is, like with vanilla Deforum video input, you give it a path and it'll extract the frames and apply the controlnet params to each extracted frame. That way, it's a one-stop shop vs the user having to extract the frames, specify the input folder, specify the output folder etc. It should then stitch the video with ffmpeg as per normal. IMHO.

[kabachuha]

Yeah, I kind of already did what you said

#361

[ghost]

Many times i already have the frames already extracted in a folder. I like the layout of img2img batch settings, is simple and complete.

Input should consider both video file and directory.

[kabachuha]

Sounds good! Leave a feature request issue, so it would be more visible to the maintainers

[ghost]

Mentioned in #370!