Skip to content

Commit da7f25e

Browse files
authored
[BugFix] Qwen3-Omni / Qwen2.5-Omni thinker batching with audio input (vllm-project#451)
Signed-off-by: yinpeiqi <yinpeiqi809@gmail.com>
1 parent cbaf508 commit da7f25e

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm_omni/model_executor/models/qwen2_5_omni/qwen2_5_omni_thinker.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -90,7 +90,8 @@ def _parse_and_validate_audio_input(self, **kwargs: object) -> Qwen2_5OmniAudioF
9090
):
9191
feature_attention_mask = feature_attention_mask.reshape(-1, feature_attention_mask.shape[-1])
9292
elif feature_attention_mask is not None and isinstance(feature_attention_mask, list):
93-
feature_attention_mask = torch.cat(feature_attention_mask, dim=-1)
93+
for i in range(len(feature_attention_mask)):
94+
feature_attention_mask[i] = feature_attention_mask[i].reshape(-1)
9495
return Qwen2_5OmniAudioFeatureInputs(
9596
type="audio_features",
9697
input_features=input_audio_features,

0 commit comments

Comments
 (0)