Skip to content

Commit c0c0a97

Browse files
authored
centralize VLLM_WORKER_MULTIPROC_METHOD (#728)
Signed-off-by: Kyle Sayers <[email protected]>
1 parent f64dfa5 commit c0c0a97

File tree

2 files changed

+1
-1
lines changed

2 files changed

+1
-1
lines changed

examples/models/vllm_qwen2vl.sh

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,6 @@
44

55
# cd ~/prod/lmms-eval-public
66
# pip3 install -e .
7-
export VLLM_WORKER_MULTIPROC_METHOD=spawn
87
export NCCL_BLOCKING_WAIT=1
98
export NCCL_TIMEOUT=18000000
109
export NCCL_DEBUG=DEBUG

lmms_eval/models/vllm.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,7 @@ def __init__(
6060
eval_logger.warning(f"Failed to parse JSON-like string for argument '{key}': {value}")
6161

6262
# Set up vllm client
63+
os.environ["VLLM_WORKER_MULTIPROC_METHOD"] = "spawn"
6364
self.client = LLM(
6465
model=self.model_version,
6566
tensor_parallel_size=tensor_parallel_size,

0 commit comments

Comments
 (0)