Skip to content

Commit 890b6a3

Browse files
fix return type
Signed-off-by: yechank <[email protected]>
1 parent 54121ed commit 890b6a3

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

tensorrt_llm/_torch/models/modeling_qwen3vl.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -651,7 +651,9 @@ def prepare_attn_metadata(self, seq_lens, attn_metadata: AttentionMetadata):
651651
return attn_metadata
652652

653653
@torch.inference_mode()
654-
def forward(self, pixel_values: torch.Tensor, grid_thw: torch.Tensor, **kwargs) -> torch.Tensor:
654+
def forward(
655+
self, pixel_values: torch.Tensor, grid_thw: torch.Tensor, **kwargs
656+
) -> Tuple[torch.Tensor, List[torch.Tensor]]:
655657
seq_lens = torch.repeat_interleave(grid_thw[:, 1] * grid_thw[:, 2], grid_thw[:, 0]).tolist()
656658
attn_metadata = self.prepare_attn_metadata(seq_lens, self.attn_metadata)
657659

0 commit comments

Comments
 (0)