Can't disable manual cast from fp8 to bf16 #7326
CaledoniaProject
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I'm trying to run flux.1 dev fp8 model with comfyui, so I started comfy with fp8 unet mode:
And my workflow
But when I run the workflow, it is very slow on L40S (44GB vRAM). And I saw a line in console
So
--fp8_e4m3fn-unet
didn't work, it does not prevent the manual cast. How should I fix it?Beta Was this translation helpful? Give feedback.
All reactions