Skip to content

Commit 3d21ed9

Browse files
authored
[Bugfix]Fix quant_config input parameter bug in qwenvl series (#3220)
### What this PR does / why we need it? Fix quant_config input parameter bug in qwenvl series. Currently, non-instantiated variables should be passed. ### Does this PR introduce _any_ user-facing change? None ### How was this patch tested? - vLLM version: v0.10.2 - vLLM main: vllm-project/vllm@releases/v0.11.0 Signed-off-by: booker123456 <[email protected]>
1 parent 96089b5 commit 3d21ed9

File tree

3 files changed

+5
-5
lines changed

3 files changed

+5
-5
lines changed

vllm_ascend/models/qwen2_5_vl.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -509,7 +509,7 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
509509
self.visual = AscendQwen2_5_VisionTransformer(
510510
vision_config=config.vision_config,
511511
norm_eps=getattr(config, "rms_norm_eps", 1e-6),
512-
quant_config=self.quant_config,
512+
quant_config=quant_config,
513513
prefix=maybe_prefix(prefix, "visual"),
514514
)
515515

vllm_ascend/models/qwen2_5_vl_without_padding.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -495,7 +495,7 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
495495
self.visual = AscendQwen2_5_VisionTransformer_Without_Padding(
496496
vision_config=config.vision_config,
497497
norm_eps=getattr(config, "rms_norm_eps", 1e-6),
498-
quant_config=self.quant_config,
498+
quant_config=quant_config,
499499
prefix=maybe_prefix(prefix, "visual"),
500500
)
501501

@@ -574,7 +574,7 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
574574
self.visual = AscendQwen3_VisionTransformer(
575575
config.vision_config,
576576
norm_eps=getattr(config, "rms_norm_eps", 1e-6),
577-
quant_config=self.quant_config,
577+
quant_config=quant_config,
578578
prefix=maybe_prefix(prefix, "visual"),
579579
use_data_parallel=self.use_data_parallel)
580580

@@ -625,7 +625,7 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
625625
self.visual = AscendQwen3_VisionTransformer(
626626
config.vision_config,
627627
norm_eps=getattr(config, "rms_norm_eps", 1e-6),
628-
quant_config=self.quant_config,
628+
quant_config=quant_config,
629629
prefix=maybe_prefix(prefix, "visual"),
630630
use_data_parallel=self.use_data_parallel,
631631
)

vllm_ascend/models/qwen2_vl.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -357,6 +357,6 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
357357
self.visual = AscendQwen2VisionTransformer(
358358
self.config.vision_config,
359359
norm_eps=getattr(self.config, "rms_norm_eps", 1e-6),
360-
quant_config=self.vllm_config.quant_config,
360+
quant_config=vllm_config.quant_config,
361361
prefix=maybe_prefix(prefix, "visual"),
362362
)

0 commit comments

Comments
 (0)