Skip to content

Commit 9d1006e

Browse files
authored
Fix seed for torchrun (#209)
Signed-off-by: Hemil Desai <[email protected]>
1 parent 33c0e0b commit 9d1006e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

nemo_run/run/torchx_backend/components/torchrun.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,7 @@ def torchrun(
119119
master_addr = os.environ["MASTER_ADDR"]
120120
master_port = os.environ["MASTER_PORT"]
121121
rdzv_endpoint = torchx_dist._noquote(master_addr + ":" + master_port)
122-
random.seed(rdzv_id)
122+
random.seed(rdzv_endpoint)
123123
else:
124124
rdzv_endpoint = torchx_dist._noquote(f"$${ExecutorMacros.HEAD_NODE_IP_VAR}:{rdzv_port}")
125125

0 commit comments

Comments
 (0)