[ROCm][SymmMem] Fix skip condition for PLATFORM_SUPPORTS_SYMM_MEM (pytorch#163205)

It seems `TEST_CUDA` is set to true even for ROCm (MI200) jobs. Changing if TEST_CUDA to an else condition to avoid running symmetric memory UTs on MI200. For other non-rocm arch, it should return true and can be skipped using other skip decorators.

Pull Request resolved: pytorch#163205
Approved by: https://github.com/ezyang

Co-authored-by: Jeff Daily <[email protected]>

Author: 2 people

torch/testing/_internal/common_distributed.py

@@ -414,15 +414,17 @@ def requires_multicast_support():
 
 
 def evaluate_platform_supports_symm_mem():
-    if TEST_WITH_ROCM:
-        arch_list = ["gfx942", "gfx950"]
-        for arch in arch_list:
-            if arch in torch.cuda.get_device_properties(0).gcnArchName:
-                return True
     if TEST_CUDA:
-        return True
-
-    return False
+        if TEST_WITH_ROCM:
+            arch_list = ["gfx942", "gfx950"]
+            for arch in arch_list:
+                if arch in torch.cuda.get_device_properties(0).gcnArchName:
+                    return True
+            return False
+        else:
+            return True
+    else:
+        return False
 
 
 PLATFORM_SUPPORTS_SYMM_MEM: bool = LazyVal(