Skip to content

fix: update support matrix [harrli/support-matrix]#574

Open
github-actions[bot] wants to merge 8 commits intomainfrom
automated/update-support-matrix-harrli/support-matrix
Open

fix: update support matrix [harrli/support-matrix]#574
github-actions[bot] wants to merge 8 commits intomainfrom
automated/update-support-matrix-harrli/support-matrix

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Mar 11, 2026

Updated by workflow run #150

This PR updates aiconfigurator/systems/support_matrix.csv with the following changes:

Summary

Category Count
Regressions (PASS -> FAIL) 28
Fixed (FAIL -> PASS) 8
Removed rows 342
Added rows 1154

1. Regressions (PASS -> FAIL): 28 rows

HuggingFaceID Architecture System Backend Version Mode Previous Status New Status
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm vllm 0.12.0 agg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm vllm 0.12.0 disagg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm vllm 0.14.0 agg PASS FAIL
Qwen/Qwen3-Coder-480B-A35B-Instruct Qwen3MoeForCausalLM h100_sxm vllm 0.14.0 disagg PASS FAIL
deepseek-ai/DeepSeek-V3 DeepseekV3ForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS FAIL
deepseek-ai/DeepSeek-V3 DeepseekV3ForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS FAIL
deepseek-ai/DeepSeek-V3 DeepseekV3ForCausalLM gb200 trtllm 1.0.0rc6 agg PASS FAIL
deepseek-ai/DeepSeek-V3 DeepseekV3ForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS FAIL
deepseek-ai/DeepSeek-V3 DeepseekV3ForCausalLM gb200 trtllm 1.2.0rc5 agg PASS FAIL
deepseek-ai/DeepSeek-V3 DeepseekV3ForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM gb200 trtllm 1.0.0rc6 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM gb200 trtllm 1.2.0rc5 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm vllm 0.12.0 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm vllm 0.12.0 disagg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm vllm 0.14.0 agg PASS FAIL
meta-llama/Meta-Llama-3.1-405B LlamaForCausalLM h100_sxm vllm 0.14.0 disagg PASS FAIL

2. Fixed (FAIL -> PASS): 8 rows

HuggingFaceID Architecture System Backend Version Mode Previous Status New Status
meta-llama/Meta-Llama-3.1-70B LlamaForCausalLM l40s sglang 0.5.5.post3 agg FAIL PASS
meta-llama/Meta-Llama-3.1-70B LlamaForCausalLM l40s sglang 0.5.5.post3 disagg FAIL PASS
meta-llama/Meta-Llama-3.1-70B LlamaForCausalLM l40s trtllm 1.0.0 agg FAIL PASS
meta-llama/Meta-Llama-3.1-70B LlamaForCausalLM l40s trtllm 1.0.0 disagg FAIL PASS
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 NemotronHForCausalLM b200_sxm trtllm 1.2.0rc5 agg FAIL PASS
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 NemotronHForCausalLM b200_sxm trtllm 1.2.0rc5 disagg FAIL PASS
nvidia/NVIDIA-Nemotron-3-Super-120B-NVFP4-FP8KV NemotronHForCausalLM b200_sxm trtllm 1.2.0rc5 agg FAIL PASS
nvidia/NVIDIA-Nemotron-3-Super-120B-NVFP4-FP8KV NemotronHForCausalLM b200_sxm trtllm 1.2.0rc5 disagg FAIL PASS

3. Removed rows: 342

HuggingFaceID Architecture System Backend Version Mode Status
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM a100_sxm sglang 0.5.8 agg FAIL
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM a100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM a100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM h200_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM l40s sglang 0.5.5.post3 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM l40s sglang 0.5.5.post3 disagg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM l40s trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-1.5B Qwen2ForCausalLM l40s trtllm 1.0.0 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM a100_sxm sglang 0.5.8 agg FAIL
Qwen/Qwen2.5-32B Qwen2ForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
Qwen/Qwen2.5-32B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM a100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM a100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM h200_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM l40s sglang 0.5.5.post3 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM l40s sglang 0.5.5.post3 disagg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM l40s trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-32B Qwen2ForCausalLM l40s trtllm 1.0.0 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM a100_sxm sglang 0.5.8 agg FAIL
Qwen/Qwen2.5-72B Qwen2ForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
Qwen/Qwen2.5-72B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM a100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM a100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM h200_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-72B Qwen2ForCausalLM l40s sglang 0.5.5.post3 agg FAIL
Qwen/Qwen2.5-72B Qwen2ForCausalLM l40s sglang 0.5.5.post3 disagg FAIL
Qwen/Qwen2.5-72B Qwen2ForCausalLM l40s trtllm 1.0.0 agg FAIL
Qwen/Qwen2.5-72B Qwen2ForCausalLM l40s trtllm 1.0.0 disagg FAIL
Qwen/Qwen2.5-7B Qwen2ForCausalLM a100_sxm sglang 0.5.8 agg FAIL
Qwen/Qwen2.5-7B Qwen2ForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
Qwen/Qwen2.5-7B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM a100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM a100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm vllm 0.12.0 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM h200_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM l40s sglang 0.5.5.post3 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM l40s sglang 0.5.5.post3 disagg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM l40s trtllm 1.0.0 agg PASS
Qwen/Qwen2.5-7B Qwen2ForCausalLM l40s trtllm 1.0.0 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM a100_sxm sglang 0.5.8 agg FAIL
meta-llama/Llama-2-13b-hf LlamaForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
meta-llama/Llama-2-13b-hf LlamaForCausalLM a100_sxm trtllm 1.0.0 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM a100_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM a100_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm vllm 0.14.0 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h100_sxm vllm 0.14.0 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM h200_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM l40s sglang 0.5.5.post3 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM l40s sglang 0.5.5.post3 disagg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM l40s trtllm 1.0.0 agg PASS
meta-llama/Llama-2-13b-hf LlamaForCausalLM l40s trtllm 1.0.0 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM a100_sxm sglang 0.5.8 agg FAIL
meta-llama/Llama-2-70b-hf LlamaForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
meta-llama/Llama-2-70b-hf LlamaForCausalLM a100_sxm trtllm 1.0.0 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM a100_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM a100_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm vllm 0.14.0 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h100_sxm vllm 0.14.0 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM h200_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-70b-hf LlamaForCausalLM l40s sglang 0.5.5.post3 agg FAIL
meta-llama/Llama-2-70b-hf LlamaForCausalLM l40s sglang 0.5.5.post3 disagg FAIL
meta-llama/Llama-2-70b-hf LlamaForCausalLM l40s trtllm 1.0.0 agg FAIL
meta-llama/Llama-2-70b-hf LlamaForCausalLM l40s trtllm 1.0.0 disagg FAIL
meta-llama/Llama-2-7b-hf LlamaForCausalLM a100_sxm sglang 0.5.8 agg FAIL
meta-llama/Llama-2-7b-hf LlamaForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
meta-llama/Llama-2-7b-hf LlamaForCausalLM a100_sxm trtllm 1.0.0 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM a100_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM a100_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm vllm 0.14.0 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h100_sxm vllm 0.14.0 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm vllm 0.12.0 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM h200_sxm vllm 0.12.0 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM l40s sglang 0.5.5.post3 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM l40s sglang 0.5.5.post3 disagg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM l40s trtllm 1.0.0 agg PASS
meta-llama/Llama-2-7b-hf LlamaForCausalLM l40s trtllm 1.0.0 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM a100_sxm sglang 0.5.8 agg FAIL
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM a100_sxm trtllm 1.0.0 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM a100_sxm vllm 0.12.0 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM a100_sxm vllm 0.12.0 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm vllm 0.12.0 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm vllm 0.12.0 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm vllm 0.14.0 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h100_sxm vllm 0.14.0 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm vllm 0.12.0 agg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM h200_sxm vllm 0.12.0 disagg PASS
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM l40s sglang 0.5.5.post3 agg FAIL
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM l40s sglang 0.5.5.post3 disagg FAIL
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM l40s trtllm 1.0.0 agg FAIL
mistralai/Mixtral-8x22B-v0.1 MixtralForCausalLM l40s trtllm 1.0.0 disagg FAIL
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM a100_sxm sglang 0.5.8 agg FAIL
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM a100_sxm trtllm 1.0.0 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM a100_sxm trtllm 1.0.0 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM a100_sxm vllm 0.12.0 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM a100_sxm vllm 0.12.0 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.0.0rc6 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.0.0rc6 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM gb200 trtllm 1.0.0rc6 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM gb200 trtllm 1.0.0rc6 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM gb200 trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM gb200 trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm vllm 0.12.0 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm vllm 0.12.0 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm vllm 0.14.0 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h100_sxm vllm 0.14.0 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm vllm 0.12.0 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM h200_sxm vllm 0.12.0 disagg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM l40s sglang 0.5.5.post3 agg FAIL
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM l40s sglang 0.5.5.post3 disagg FAIL
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM l40s trtllm 1.0.0 agg PASS
mistralai/Mixtral-8x7B-v0.1 MixtralForCausalLM l40s trtllm 1.0.0 disagg PASS

4. Added rows: 1154

HuggingFaceID Architecture System Backend Version Mode Status
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm sglang 0.5.8 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm sglang 0.5.8.post1 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm sglang 0.5.8.post1 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm sglang 0.5.9 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm sglang 0.5.9 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm trtllm 1.0.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm trtllm 1.0.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm vllm 0.12.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm vllm 0.12.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm vllm 0.14.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM a100_sxm vllm 0.14.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm sglang 0.5.6.post2 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm sglang 0.5.6.post2 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm sglang 0.5.9 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm sglang 0.5.9 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm trtllm 1.0.0rc6 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm trtllm 1.0.0rc6 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm trtllm 1.2.0rc5 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm trtllm 1.2.0rc5 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm vllm 0.14.1 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM b200_sxm vllm 0.14.1 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 sglang 0.5.8.post1 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 sglang 0.5.8.post1 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 sglang 0.5.9 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 sglang 0.5.9 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.0.0rc6 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.0.0rc6 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.1.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.1.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.2.0rc5 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.2.0rc5 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.2.0rc6 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 trtllm 1.2.0rc6 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 vllm 0.14.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb200 vllm 0.14.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb300 sglang 0.5.9 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb300 sglang 0.5.9 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb300 trtllm 1.2.0rc6.post3 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm sglang 0.5.6.post2 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm sglang 0.5.6.post2 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm sglang 0.5.8.post1 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm sglang 0.5.8.post1 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm trtllm 1.0.0rc3 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm trtllm 1.0.0rc3 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm trtllm 1.2.0rc5 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm trtllm 1.2.0rc5 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm vllm 0.12.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm vllm 0.12.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm vllm 0.14.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h100_sxm vllm 0.14.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm sglang 0.5.6.post2 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm sglang 0.5.6.post2 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm sglang 0.5.9 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm sglang 0.5.9 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm trtllm 1.0.0rc3 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm trtllm 1.0.0rc3 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm trtllm 1.2.0rc5 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm trtllm 1.2.0rc5 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm vllm 0.12.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM h200_sxm vllm 0.12.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s sglang 0.5.5.post3 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s sglang 0.5.5.post3 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s sglang 0.5.9 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s sglang 0.5.9 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s trtllm 1.0.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s trtllm 1.0.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s vllm 0.12.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s vllm 0.12.0 disagg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s vllm 0.14.0 agg FAIL
MiniMaxAI/MiniMax-M2.5 MiniMaxM2ForCausalLM l40s vllm 0.14.0 disagg FAIL
Qwen/Qwen3-0.6B Qwen3ForCausalLM a100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM a100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM a100_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM a100_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM a100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM a100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM b200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM b200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM b200_sxm vllm 0.14.1 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM b200_sxm vllm 0.14.1 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 sglang 0.5.9 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 sglang 0.5.9 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 trtllm 1.1.0 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 trtllm 1.1.0 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 trtllm 1.2.0rc6 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 trtllm 1.2.0rc6 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 vllm 0.14.0 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb200 vllm 0.14.0 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb300 sglang 0.5.9 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb300 sglang 0.5.9 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb300 trtllm 1.2.0rc6.post3 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM h100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM h100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM h200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM h200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM l40s sglang 0.5.9 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM l40s sglang 0.5.9 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM l40s vllm 0.12.0 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM l40s vllm 0.12.0 disagg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM l40s vllm 0.14.0 agg PASS
Qwen/Qwen3-0.6B Qwen3ForCausalLM l40s vllm 0.14.0 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM a100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM a100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM a100_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM a100_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM a100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM a100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM b200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM b200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM b200_sxm vllm 0.14.1 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM b200_sxm vllm 0.14.1 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 sglang 0.5.9 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 sglang 0.5.9 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 trtllm 1.1.0 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 trtllm 1.1.0 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 trtllm 1.2.0rc6 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 trtllm 1.2.0rc6 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 vllm 0.14.0 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb200 vllm 0.14.0 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb300 sglang 0.5.9 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb300 sglang 0.5.9 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb300 trtllm 1.2.0rc6.post3 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM h100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM h100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM h200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM h200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM l40s sglang 0.5.9 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM l40s sglang 0.5.9 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM l40s vllm 0.12.0 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM l40s vllm 0.12.0 disagg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM l40s vllm 0.14.0 agg PASS
Qwen/Qwen3-1.7B Qwen3ForCausalLM l40s vllm 0.14.0 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 trtllm 1.1.0 agg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 trtllm 1.1.0 disagg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 vllm 0.14.0 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb200 vllm 0.14.0 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb300 sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb300 sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM h200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM h200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM l40s sglang 0.5.9 agg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM l40s sglang 0.5.9 disagg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM l40s vllm 0.12.0 agg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM l40s vllm 0.12.0 disagg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM l40s vllm 0.14.0 agg FAIL
Qwen/Qwen3-235B-A22B Qwen3MoeForCausalLM l40s vllm 0.14.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm trtllm 1.0.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm trtllm 1.0.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.12.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.12.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.0.0rc6 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.0.0rc6 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.0.0rc6 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.0.0rc6 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.1.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.1.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc5 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc5 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 vllm 0.14.0 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb200 vllm 0.14.0 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb300 sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb300 sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm trtllm 1.0.0rc3 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm trtllm 1.0.0rc3 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm vllm 0.12.0 agg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM h200_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s sglang 0.5.5.post3 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s sglang 0.5.5.post3 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s sglang 0.5.9 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s sglang 0.5.9 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s trtllm 1.0.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s trtllm 1.0.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s vllm 0.12.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s vllm 0.12.0 disagg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s vllm 0.14.0 agg FAIL
Qwen/Qwen3-235B-A22B-FP8 Qwen3MoeForCausalLM l40s vllm 0.14.0 disagg FAIL
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 trtllm 1.1.0 agg FAIL
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 trtllm 1.1.0 disagg FAIL
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 vllm 0.14.0 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb200 vllm 0.14.0 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb300 sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb300 sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM h200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM h200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM l40s sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM l40s sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM l40s vllm 0.12.0 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM l40s vllm 0.12.0 disagg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM l40s vllm 0.14.0 agg PASS
Qwen/Qwen3-30B-A3B Qwen3MoeForCausalLM l40s vllm 0.14.0 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.8.post1 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm sglang 0.5.9 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm trtllm 1.0.0 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm trtllm 1.0.0 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.12.0 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.12.0 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM a100_sxm vllm 0.14.0 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.0.0rc6 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.0.0rc6 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM b200_sxm vllm 0.14.1 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.0.0rc6 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.0.0rc6 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.1.0 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.1.0 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc5 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc5 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 trtllm 1.2.0rc6 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 vllm 0.14.0 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb200 vllm 0.14.0 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb300 sglang 0.5.9 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb300 sglang 0.5.9 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM gb300 trtllm 1.2.0rc6.post3 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.6.post2 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.6.post2 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm sglang 0.5.8.post1 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.0.0rc3 agg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.0.0rc3 disagg FAIL
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.2.0rc5 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm trtllm 1.2.0rc5 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0.12.0 agg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0.12.0 disagg PASS
Qwen/Qwen3-30B-A3B-FP8 Qwen3MoeForCausalLM h100_sxm vllm 0

@copy-pr-bot
Copy link

copy-pr-bot bot commented Mar 11, 2026

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Base automatically changed from harrli/support-matrix to main March 11, 2026 21:35
@Harrilee Harrilee requested a review from a team as a code owner March 11, 2026 21:35
@github-actions github-actions bot added the fix label Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tianhaox tianhaox Awaiting requested review from tianhaox tianhaox is a code owner

@jasonqinzhou jasonqinzhou Awaiting requested review from jasonqinzhou jasonqinzhou is a code owner

@YijiaZhao YijiaZhao Awaiting requested review from YijiaZhao YijiaZhao is a code owner

@ilyasher ilyasher Awaiting requested review from ilyasher ilyasher is a code owner

@simone-chen simone-chen Awaiting requested review from simone-chen simone-chen is a code owner

@Harrilee Harrilee Awaiting requested review from Harrilee Harrilee is a code owner

@Arsene12358 Arsene12358 Awaiting requested review from Arsene12358 Arsene12358 is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

automated fix support-matrix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Harrilee