You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[0.9.1] cancel the verification between deepseek_mtp and non-ascend scheduler in disaggregated_prefill deployment (#2368)
### What this PR does / why we need it?
Currently deepseek_mtp can be enabled with original vllm scheduler only
in disaggregated prefill scenarios (experimental). This pr change the
verification logic to allow users to enable deepseek_mtp without ascend
scheduler in disaggregated prefill deployments.
### Does this PR introduce _any_ user-facing change?
Users can enable deepseek_mtp model without ascend scheduler in
disaggregated_prefill deployments.
### How was this patch tested?
CI and e2e vllm serving passed.
Signed-off-by: linfeng-yuan <[email protected]>
0 commit comments