Skip to content

Commit 89fca67

Browse files
authored
[V1] Default MLA to V1 (#14921)
Signed-off-by: simon-mo <[email protected]>
1 parent d20b0c1 commit 89fca67

File tree

1 file changed

+1
-5
lines changed

1 file changed

+1
-5
lines changed

vllm/engine/arg_utils.py

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1191,7 +1191,7 @@ def create_engine_config(
11911191
NOTE: for autoselection of V0 vs V1 engine, we need to
11921192
create the ModelConfig first, since ModelConfig's attrs
11931193
(e.g. the model arch) are needed to make the decision.
1194-
1194+
11951195
This function set VLLM_USE_V1=X if VLLM_USE_V1 is
11961196
unspecified by the user.
11971197
@@ -1576,10 +1576,6 @@ def _is_v1_supported_oracle(self, model_config: ModelConfig) -> bool:
15761576
#############################################################
15771577
# Experimental Features - allow users to opt in.
15781578

1579-
# MLA is is supported on V1, but off by default for now.
1580-
if model_config.use_mla and _warn_or_fallback("MLA"):
1581-
return False
1582-
15831579
# LoRA is supported on V1, but off by default for now.
15841580
if self.enable_lora and _warn_or_fallback("LORA"):
15851581
return False

0 commit comments

Comments
 (0)