HUNYUANIMAGE2.1 GGUF HELP #335
BotLifeGamer
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hello i followed your steps i turn it into a gguf file and then i get this when trying to Quantize it. Also very new to this.
(venv) PS E:\ComfyUI\custom_nodes\ComfyUI-GGUF\tools> llama.cpp\build\bin\Debug\llama-quantize.exe E:\ComfyUI\models\unet\hunyuanimage2.1.GGUF E:\ComfyUI\models\unet\hunyuanimage2.1-Q4_K_S.gguf Q4_K_S
main: build = 3962 (c8c07d65)
main: built with MSVC 19.44.35214.0 for x64
main: quantizing 'E:\ComfyUI\models\unet\hunyuanimage2.1.GGUF' to 'E:\ComfyUI\models\unet\hunyuanimage2.1-Q4_K_S.gguf' as Q4_K_S
llama_model_loader: loaded meta data with 3 key-value pairs and 856 tensors from E:\ComfyUI\models\unet\hunyuanimage2.1.GGUF (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv 0: general.architecture str = hyvid
llama_model_loader: - kv 1: general.quantization_version u32 = 2
llama_model_loader: - kv 2: general.file_type u32 = 32
llama_model_loader: - type f32: 513 tensors
llama_model_loader: - type bf16: 343 tensors
llama_model_quantize: failed to quantize: img_in.proj.weight size failed for HyVid
main: failed to quantize model from 'E:\ComfyUI\models\unet\hunyuanimage2.1.GGUF'
Beta Was this translation helpful? Give feedback.
All reactions