We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 7fc845c commit d6bc0b3Copy full SHA for d6bc0b3
docs/guides/mlp_tutorials/llm-nanotron-training.md
@@ -229,7 +229,7 @@ srun -ul --environment=nanotron bash -c "
229
--master-addr=\${MASTER_ADDR} \
230
--master-port=\${MASTER_PORT} \
231
--nnodes=\${SLURM_NNODES} \
232
- --nproc-per-node=\${SLURM_GPUS_PER_TASK} \
+ --nproc-per-node=\${SLURM_GPUS_ON_NODE} \
233
\"
234
235
torchrun \${TORCHRUN_ARGS} run_train.py --config-file examples/config_tiny_llama_wikitext.yaml
0 commit comments