Skip to content

Commit dea3ec1

Browse files
authored
Fix numbering of annotations for env vars in pytorch documentation (#151)
1 parent b37fee3 commit dea3ec1

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

docs/software/ml/pytorch.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -387,9 +387,9 @@ srun bash -c "
387387
5. Set the Trition home to a local path (e.g. `/dev/shm`) to avoid writing to the (distributed) file system.
388388
This is important for performance, as writing to the Lustre file system can be slow due to the amount of small files and potentially many processes accessing it.
389389
6. Disable GPU support in MPICH, as it [can lead to deadlocks](https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/mpi.html#inter-gpu-communication-with-cuda-aware-mpi) when using together with nccl.
390-
6. Avoid writing JITed binaries to the (distributed) file system, which could lead to performance issues.
391-
7. These variables should always be set for correctness and optimal performance when using NCCL, see [the detailed explanation][ref-communication-nccl].
392-
8. `RANK` and `LOCAL_RANK` are set per-process by the SLURM job launcher.
390+
7. Avoid writing JITed binaries to the (distributed) file system, which could lead to performance issues.
391+
8. These variables should always be set for correctness and optimal performance when using NCCL, see [the detailed explanation][ref-communication-nccl].
392+
9. `RANK` and `LOCAL_RANK` are set per-process by the SLURM job launcher.
393393
10. Activate the virtual environment created on top of the uenv (if any).
394394
Please follow the guidelines for [python virtual environments with uenv][ref-guides-storage-venv] to enhance scalability and reduce load times.
395395

0 commit comments

Comments
 (0)