Skip to content

Conversation

@painebenjamin
Copy link

Hello!

I was impatient and wanted to get this to work, so I tried installing from your branch. There were various issues that needed to be fixed for it to work, though.

You can see a working version running in a ZeroGPU space: https://huggingface.co/spaces/benjamin-paine/Lumina-Image-2.0

In addition to these code changes, I had to do two other things:

  1. I had to change ffn_dim_multiplier from null to 1.5 in transformer/config.json
  2. I had to rename the context_refiner.<N>.norm1.norm weights to remove the final .norm part since you made the context_refiner normalization layers plain RMSNorms.

Both of those changes are in a repository on HF at https://huggingface.co/benjamin-paine/Lumina-Image-2.0/tree/main.

Once the model is settled in your main repository I'll go ahead and delete my copies so there's no confusion. :)

Thank you for your hard work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant