Skip to content

Commit ea6cc68

Browse files
Added Fix for Loading unquantized Huggingface models. (#771)
* Added banned_strings parameter to the generator. * Added Fix for loading unquantized huggingface models. --------- Co-authored-by: RaahimSiddiqi <[email protected]>
1 parent 3a90264 commit ea6cc68

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

exllamav2/config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -584,7 +584,7 @@ def check_keys(archparams, prefix):
584584
self.vision_intermediate_size = read(read_config, int, ["vision_config->intermediate_size"], no_default)
585585
self.vision_fullatt_block_indexes = read(read_config, list, ["vision_config->fullatt_block_indexes", None])
586586
self.vision_window_size = read(read_config, int, ["vision_config->window_size", None])
587-
assert image_processor_type == "Qwen2_5_VLImageProcessor", \
587+
assert image_processor_type == "Qwen2_5_VLImageProcessor" or image_processor_type == "Qwen2VLImageProcessor", \
588588
f"Wrong image processor type: {image_processor_type}"
589589
self.vision_merger_intermediate_size = 5120 # TODO: This doesn't seem to appear in the config anywhere?
590590

0 commit comments

Comments
 (0)