Loopback with ControlNet does not feed previously generated frame to preprocessor/model when in "Video" animation mode.

[toomstoxx]

When I have a ControlNet processor with "Loopback" enabled, I'd expect the previously generated frame to be fed as the input image to that ControlNet for the frame that is currently being generated. This is what happens in 2D/3D animation mode.

Instead, in Video animation mode, it simply feeds ControlNet the current frame from the source video.

I thought that we were supposed to be able to use LoopBack with ControlNet to use the previously generated frame to influence the current frame. Am I misunderstanding how this is meant to work, or is this a bug?

Also, I would like to be able to provide any ControlNet that has LoopBack with an init image. Again, in Video animation mode, the init image is set to be the first frame of the source video, rather than the image passed in the init tab.

[hithereai]

Thanks for reporting!

I will look into it in a week or two, can't have any changes made right now as we work on a big update.

Regarding setting different inits for CN modules in LP mode - it's possible to add, right now they will take the init_image if it's enabled and set - so they all share init frame sadly.