Skip to content

Commit 0f9025c

Browse files
[EPLB] Eplb Verify Fix (#4334)
### What this PR does / why we need it? Eplb Verify Fix --------- Signed-off-by: shenchuxiaofugui <[email protected]> Signed-off-by: LI SHENGYONG <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1 parent 97ffb91 commit 0f9025c

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm_ascend/ops/common_fused_moe.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -250,7 +250,8 @@ def __init__(self, *args, **kwargs):
250250
dtype=torch.int64).npu()
251251

252252
eplb_enable = self.dynamic_eplb or (self.expert_map_path is not None)
253-
if eplb_enable and (not isinstance(self.quant_method,
253+
if eplb_enable and (not hasattr(self.quant_method, "quant_method") or
254+
not isinstance(self.quant_method.quant_method,
254255
AscendW8A8DynamicFusedMoEMethod)):
255256
raise ValueError("Eplb supports only w8a8_dynamic quantization.")
256257

0 commit comments

Comments
 (0)