Skip to content

Commit 617ca5b

Browse files
committed
guard against multimodal_input being None
Signed-off-by: john calderon <jcalderon@nvidia.com>
1 parent 099465e commit 617ca5b

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tensorrt_llm/_torch/pyexecutor/_util.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -174,7 +174,8 @@ def _create_dummy_mm_context_request(
174174
req_mm_input = trtllm.MultimodalInput(
175175
multimodal_hashes=multimodal_input.multimodal_hashes,
176176
multimodal_positions=multimodal_input.multimodal_positions,
177-
multimodal_lengths=multimodal_input.multimodal_lengths)
177+
multimodal_lengths=multimodal_input.multimodal_lengths
178+
) if multimodal_input else None
178179
request = trtllm.Request(prompt_token_ids,
179180
max_tokens=1,
180181
streaming=False,

0 commit comments

Comments
 (0)