Skip to content

Commit fc79606

Browse files
authored
only import vllm serve cli if its being called (axolotl-ai-cloud#2597) [skip ci]
1 parent baeb002 commit fc79606

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/axolotl/cli/main.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,6 @@
2828
fetch_from_github,
2929
filter_none_kwargs,
3030
)
31-
from axolotl.cli.vllm_serve import do_vllm_serve
3231
from axolotl.integrations.lm_eval.cli import lm_eval
3332
from axolotl.utils import set_pytorch_cuda_alloc_conf
3433
from axolotl.utils.schemas.config import AxolotlInputConfig
@@ -327,6 +326,8 @@ def fetch(directory: str, dest: Optional[str]) -> None:
327326
@add_options_from_dataclass(VllmServeCliArgs)
328327
@filter_none_kwargs
329328
def vllm_serve(config: str, **cli_args: VllmServeCliArgs):
329+
from axolotl.cli.vllm_serve import do_vllm_serve
330+
330331
do_vllm_serve(config, cli_args)
331332

332333

0 commit comments

Comments
 (0)