Skip to content

Conversation

@sayakpaul
Copy link
Collaborator

Run like:

python convert_flux_to_gguf.py /fsx/sayak/.cache/models--black-forest-labs--FLUX.1-dev/snapshots/303875135fff3f05b6aa893d544f28833a237d58/transformer/ --outfile model-Q4_0.gguf --outtype Q4_0

To be able to support inference with the output file, we need some changes which I am working on.

@sayakpaul
Copy link
Collaborator Author

With changes in huggingface/diffusers#11684, it should be possible to run the converted checkpoint:

image

Copy link
Owner

@ngxson ngxson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice, thanks!

@ngxson ngxson merged commit 3d24bb2 into ngxson:main Jun 10, 2025
1 check passed
@sayakpaul sayakpaul deleted the support-diffusers-ckpt branch June 10, 2025 09:34
@sayakpaul
Copy link
Collaborator Author

Try and let us know.

@nitinmukesh
Copy link

Try and let us know.

Sorry I deleted from here and posted a new
#2

Will try now

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants