Skip to content

Commit 34cb6a9

Browse files
ratnampaPradyun Ramadorai
authored andcommitted
[Intel GPU] Ray Compiled Graph avoid NCCL for Intel GPU (vllm-project#21338)
Signed-off-by: ratnampa <[email protected]>
1 parent bfe4532 commit 34cb6a9

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/executor/ray_distributed_executor.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -67,8 +67,8 @@ def _init_executor(self) -> None:
6767
os.environ["VLLM_USE_RAY_SPMD_WORKER"] = "1"
6868
os.environ["VLLM_USE_RAY_COMPILED_DAG"] = "1"
6969

70-
# For TPU, avoid compiling NVIDIA's NCCL
71-
if current_platform.is_tpu():
70+
# For TPU or XPU, avoid compiling NVIDIA's NCCL
71+
if current_platform.is_tpu() or current_platform.is_xpu():
7272
os.environ["VLLM_USE_RAY_COMPILED_DAG_CHANNEL_TYPE"] = "shm"
7373

7474
# If the env var is set, it uses the Ray's compiled DAG API

0 commit comments

Comments
 (0)