Is lumina-2.0 script correct?

[Riko0]

I wrote a script, based on the one provided here

it gets stuck on loss around 0.5, and i think it is a lot, isn't it?

[a-r-r-o-w]

Could you share your loss curves? If you're using a custom script, it will be out-of-scope for us to look into

cc @sayakpaul

[sayakpaul]

Have you performed intermediate validation? Can you share those results?

[Riko0]

In my case, i based on your script to train (full, starting from huggingface checkpoint) in style of instruct pix2pix (with additional channels if input image) and also change of text encoder

There is loss curve:

It meets plateau at around 0.5-0.6 value

There is a collage of eval pictures, it seems a little off, like bad jpeg quality, and it is not logging problem, i checked

Condition picture is a better quality