Commit 6f35665
committed
test: add multimodal model fallback tests
Add TestMultimodalModelFallbacks class to verify the fallback mechanism
works correctly for models in MULTIMODAL_MATRIX:
- HCXVisionForCausalLM (CHUNKED_PREFILL=NO)
- LlavaLlamaModel (VILA) (CHUNKED_PREFILL=NO, KV_CACHE_REUSE=NO)
- Llama4ForConditionalGeneration (in both matrices)
- Qwen2VLForConditionalGeneration (all features YES)
Also removes redundant inline comments from fallback code.
Signed-off-by: Venky Ganesh <23023424+venkywonka@users.noreply.github.com>1 parent fb6e36f commit 6f35665
File tree
2 files changed
+57
-9
lines changed- tensorrt_llm/llmapi
- tests/unittest/llmapi
2 files changed
+57
-9
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
331 | 331 | | |
332 | 332 | | |
333 | 333 | | |
334 | | - | |
335 | 334 | | |
336 | 335 | | |
337 | 336 | | |
338 | 337 | | |
339 | 338 | | |
340 | 339 | | |
341 | 340 | | |
342 | | - | |
343 | 341 | | |
344 | 342 | | |
345 | 343 | | |
| |||
348 | 346 | | |
349 | 347 | | |
350 | 348 | | |
351 | | - | |
352 | | - | |
353 | | - | |
354 | | - | |
355 | | - | |
356 | | - | |
357 | | - | |
358 | 349 | | |
359 | 350 | | |
360 | 351 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
326 | 326 | | |
327 | 327 | | |
328 | 328 | | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
| 347 | + | |
| 348 | + | |
| 349 | + | |
| 350 | + | |
| 351 | + | |
| 352 | + | |
| 353 | + | |
| 354 | + | |
| 355 | + | |
| 356 | + | |
| 357 | + | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
| 364 | + | |
| 365 | + | |
| 366 | + | |
| 367 | + | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
| 374 | + | |
| 375 | + | |
| 376 | + | |
| 377 | + | |
| 378 | + | |
| 379 | + | |
| 380 | + | |
| 381 | + | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
329 | 386 | | |
330 | 387 | | |
0 commit comments