Skip to content

Commit 2e406a2

Browse files
committed
Add comment about HWLOC_KEEP_NVIDIA_GPU_NUMA_NODES
1 parent bd88ff1 commit 2e406a2

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

docs/running/slurm.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -300,7 +300,9 @@ if [[ $SLURM_LOCALID -eq 0 ]]; then
300300
CUDA_VISIBLE_DEVICES=0,1,2,3 nvidia-cuda-mps-control -d
301301
fi
302302

303-
# Set CUDA device
303+
# Set CUDA device. Disable HWLOC_KEEP_NVIDIA_GPU_NUMA_NODES to avoid GPU NUMA
304+
# nodes appearing in the list of CUDA devices. They start appearing in hwloc
305+
# version 2.11.
304306
numa_nodes=$(HWLOC_KEEP_NVIDIA_GPU_NUMA_NODES=0 hwloc-calc --physical --intersect NUMAnode $(hwloc-bind --get --taskset))
305307
export CUDA_VISIBLE_DEVICES=$numa_nodes
306308

0 commit comments

Comments
 (0)