Deforum Seed Schedule keyframing

[jbiziou]

Hi there 🙂 I have been trying to figure out how to blend from one seed to another.
My Goal is to blend from 1 predetermined image, to another predetermined image, and let deforum help me fill the in-betweens.

What I have tried: while in 3d mode.

In the RUN tab, i set the seed behavior to "Schedule". in the KEYFRAME tab, I set the seed schedule and added my seeds like normal prompts. Ex,,,,, 0: (3792828071), 20: (1943265589), So ideally my animation would shift from 1 seed to the other. in the PROMPT tab, I entered my prompts to match my Seeds. {
"0": "3/4 photo of an apple on a table, 1 point perspective, centered",
"20": "3/4 photo of a meat sandwich on a table, 1 point perspective, centered"
}
No blending is happening.
I would greatly appreciate any understanding of how to achieve this.

I as also confused if I even needed to add my prompts as the Seeds are the exact images I want to have at those keyframes. do they compete with the seed schedule?

Is there documentation for seed scheduling ? thanks:)

[ghost]

I think it would be better to use "seed travel" script, because it does exactly what you describe, at least i think so.
https://github.com/yownas/seed_travel

[jbiziou]

Hi andrei007999 :)
thanks for the response,
I have been trying the seed travel script, but alas, I can get it to sort of work,, generates my first seed over and over with out blending to my other seeds. There are some amazing scripts and things about, just with the Documentation was a little stronger. still feeling stuck,

[ghost]

That's strange, i see big gradual changes in picture on my side, while using seed travel, welp

[jbiziou]

hmmm yeah,, very strange, im not sure, I will try upping my noise scale, its pretty low to keep the image more coherent, perhaps I need to have more noise ? ill try it out

[Funofabot]

Looking at the dev in deforum webui, there was a commit that added another animation mode and in that commit when I was reviewing it, it read something like:
The reason is, this mode can also be used for seed travelling, which will be possible with the parseq integration (or without parseq if we add direct support for subseed and subseed_stregth schedules).

If I am correct and what the author of the PR is saying, the subseed act as part of the seed, and since the seed schedule is a fixed function, it currently does not know that you may want the subseed strength to reach 100% before the next iteration of the seed schedule. Not implemented like that.

It also is not hard to implement it in Deforum yourself to try things out.
I believe that editing generate.py and apply it in the p object
In the generate method, in generate.py you can manipulate the pipeline p
p.subseed = (something you want to happen)
p.subseed_strength = (something you want to happen)
and from there you can add a custom ways to manipulate the subseeds =)

in a nutshell you can change manually the frame by frame operation on the sd pipeline in the pipeline p object
the p object is the instance of StableDiffusionProcessingImg2Img from processing.py

its not ideal to edit it this way because you have to restart the console manually and it takes time to iterate that way.
Adding custom UI to help is done in a few files but its doable that way also and you would still update the generate method to reflect what the new args do to the p object.

And give some time to the deforum devs to sync work, webui version of deforum is still not sync'd with deforum 0.6 and there are differences at the moment.

I hope that helps.

[jbiziou]

Hi Funofabot :)

thank you so much for such a great well though out response, ! I really appreciate it a great deal,
Its such an incredibly fast moving and exciting time with all the development going on now,

thank you for the info about the Seed Travel :) I have been trying that and even that can not seem to get to work correctly. Honestly python and scripting are not my strength, so im slow at understanding some things. Looking at your directions, im not sure I know how to do that, so I can always wait for updates to the automatic1111 interface, or hopefully more in depth documentation.

I will try your steps and see if I can get that to work regardless:)) thank you again for the response, !!

~ Jourdan ~

[zzzgithub]

try this tutorial about blending.It's interesting
https://www.youtube.com/watch?v=v0ieUP4ewCE