Skip to content

Commit 10f1c3b

Browse files
committed
guard against multimodal_input being None
Signed-off-by: john calderon <jcalderon@nvidia.com>
1 parent 680a32c commit 10f1c3b

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tensorrt_llm/_torch/pyexecutor/_util.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -173,7 +173,8 @@ def _create_dummy_mm_context_request(
173173
req_mm_input = trtllm.MultimodalInput(
174174
multimodal_hashes=multimodal_input.multimodal_hashes,
175175
multimodal_positions=multimodal_input.multimodal_positions,
176-
multimodal_lengths=multimodal_input.multimodal_lengths)
176+
multimodal_lengths=multimodal_input.multimodal_lengths
177+
) if multimodal_input else None
177178
request = trtllm.Request(prompt_token_ids,
178179
max_tokens=1,
179180
streaming=False,

0 commit comments

Comments
 (0)