Skip to content

Commit 27e6f07

Browse files
committed
add note
1 parent ecb7d93 commit 27e6f07

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

examples/quantization_w8a8_fp8/qwen3_vl_moe_fp8_block_example.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,8 +5,12 @@
55
from llmcompressor.modeling import replace_modules_for_calibration
66
from llmcompressor.modifiers.quantization import QuantizationModifier
77

8+
# NOTE: Qwen3-VL-MoE support is not in transformers<=4.56.2
9+
# you may need to install transformes from source
10+
811
MODEL_ID = "Qwen/Qwen3-VL-235B-A22B-Instruct"
912

13+
1014
# Load model.
1115
model = Qwen3VLMoeForConditionalGeneration.from_pretrained(MODEL_ID, torch_dtype="auto")
1216
model = replace_modules_for_calibration(model)

0 commit comments

Comments
 (0)