Skip to content

Commit 2bb3aee

Browse files
Resolve deprecation of vllm.utils.get_open_port (#3398)
* Resolve deprecation of `vllm.utils.get_open_port` Signed-off-by: DarkLight1337 <[email protected]> * Fix Signed-off-by: DarkLight1337 <[email protected]> --------- Signed-off-by: DarkLight1337 <[email protected]>
1 parent 68b0365 commit 2bb3aee

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

lm_eval/models/vllm_causallms.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,10 +39,15 @@
3939
from vllm import LLM, SamplingParams, TokensPrompt
4040
from vllm.lora.request import LoRARequest
4141
from vllm.transformers_utils.tokenizer import get_tokenizer
42-
from vllm.utils import get_open_port
4342

4443
if parse_version(version("vllm")) >= parse_version("0.8.3"):
4544
from vllm.entrypoints.chat_utils import resolve_hf_chat_template
45+
46+
try:
47+
# Moved since vllm-project/vllm#27164
48+
from vllm.utils.network_utils import get_open_port
49+
except ModuleNotFoundError:
50+
from vllm.utils import get_open_port
4651
except ModuleNotFoundError:
4752
pass
4853

0 commit comments

Comments
 (0)