Skip to content

Commit b37969e

Browse files
authored
Update README.md
1 parent 0e705d1 commit b37969e

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

README.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -152,6 +152,11 @@ Via Tensorboard, you can monitor trends of ``IS, FID, F_beta, Authenticity Accur
152152

153153
* DistributedDataParallel
154154
```
155+
# export NCCL_DEBUG=INFO
156+
export NCCL_SOCKET_IFNAME=^docker0,lo
157+
export MASTER_ADDR=MASTER_IP
158+
export MASTER_PORT=MASTER_PORT
159+
155160
CUDA_VISIBLE_DEVICES=0,1,...,N python3 src/main.py -t -DDP -n TOTAL_NODES -nr CURRENT_NODE -c CONFIG_PATH
156161
```
157162
* Mixed Precision Training ([Narang et al.](https://arxiv.org/abs/1710.03740))

0 commit comments

Comments
 (0)