Skip to content

Commit 4f065f1

Browse files
authored
[Misc][V1] Skip device checking if not available (#15061)
Signed-off-by: Cody Yu <[email protected]>
1 parent 228b768 commit 4f065f1

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

vllm/engine/arg_utils.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1469,8 +1469,12 @@ def _is_v1_supported_oracle(self, model_config: ModelConfig) -> bool:
14691469
return False
14701470

14711471
# Need at least Ampere for now (FA support required).
1472+
# Skip this check if we are running on a non-GPU platform,
1473+
# or if the device capability is not available
1474+
# (e.g. in a Ray actor without GPUs).
14721475
from vllm.platforms import current_platform
14731476
if (current_platform.is_cuda()
1477+
and current_platform.get_device_capability()
14741478
and current_platform.get_device_capability().major < 8):
14751479
_raise_or_fallback(feature_name="Compute Capability < 8.0",
14761480
recommend_to_remove=False)

0 commit comments

Comments
 (0)