Skip to content

Commit 4a2e126

Browse files
authored
fix: skip vllm p2p check since its flaky (#238)
Signed-off-by: Parth Chadha <pchadha@nvidia.com>
1 parent 22af21c commit 4a2e126

File tree

1 file changed

+2
-0
lines changed
  • nemo_reinforcer/models/generation

1 file changed

+2
-0
lines changed

nemo_reinforcer/models/generation/vllm.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -109,6 +109,8 @@ def configure_worker(
109109
init_kwargs["fraction_of_gpus"] = num_gpus
110110

111111
env_vars["VLLM_ENABLE_V1_MULTIPROCESSING"] = "0"
112+
# Skip vllm P2P check and rely on driver to report peer to peer capability.
113+
env_vars["VLLM_SKIP_P2P_CHECK"] = "1"
112114

113115
return resources, env_vars, init_kwargs
114116

0 commit comments

Comments
 (0)