Skip to content

Commit 00c0e6c

Browse files
[https://nvbugs/5523315][fix] Fix serve benchmark test (#8255)
Signed-off-by: yechank <[email protected]>
1 parent cc4ab8d commit 00c0e6c

File tree

2 files changed

+1
-2
lines changed

2 files changed

+1
-2
lines changed

tensorrt_llm/serve/scripts/benchmark_dataset.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1133,7 +1133,7 @@ def sample(
11331133
if len(prompts) >= num_requests:
11341134
break
11351135
prompt = parser_fn(item)
1136-
mm_content = process_image(item["images"][0])
1136+
mm_content = [process_image(item["images"][0])]
11371137
prompt_len = len(tokenizer(prompt).input_ids)
11381138
if enable_multimodal_chat:
11391139
prompt = self.apply_multimodal_chat_transformation(

tests/integration/test_lists/waives.txt

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -284,7 +284,6 @@ accuracy/test_llm_api_pytorch.py::TestLlama3_2_3B::test_auto_dtype SKIP (https:/
284284
test_e2e.py::test_ptp_quickstart_multimodal[NVILA-8B-FP16-vila/NVILA-8B-image-False] SKIP (https://nvbugs/5444060)
285285
test_e2e.py::test_ptp_quickstart_multimodal[qwen2.5-vl-7b-instruct-Qwen2.5-VL-7B-Instruct-video-False] SKIP (https://nvbugs/5444060)
286286
test_e2e.py::test_ptp_quickstart_multimodal[qwen2.5-vl-7b-instruct-Qwen2.5-VL-7B-Instruct-video-True] SKIP (https://nvbugs/5444060)
287-
test_e2e.py::test_trtllm_multimodal_benchmark_serving SKIP (https://nvbugs/5523315)
288287
examples/test_llama.py::test_llm_llama_1gpu_fp8_kv_cache[llama-v2-7b-hf-bfloat16] SKIP (https://nvbugs/5527940)
289288
accuracy/test_llm_api_pytorch.py::TestDeepSeekR1::test_fp8_blockscale[throughput] SKIP (https://nvbugs/5481198)
290289
accuracy/test_llm_api_pytorch.py::TestDeepSeekR1::test_fp8_blockscale_chunked_prefill[latency] SKIP (https://nvbugs/5481198)

0 commit comments

Comments
 (0)