We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent debf131 commit d38ab8bCopy full SHA for d38ab8b
README.md
@@ -317,7 +317,7 @@ We recommend using `bf16` to avoid scaling and desynchronization issues with hiv
317
318
2. `RuntimeError: CUDA error: invalid device ordinal`
319
A possible culprit is that your `--nproc-per-node` argument for the torchrun launcher is set incorrectly.
320
- Please set it to an integer less than equal to the number of of gpus you have on your machine.
+ Please set it to an integer less than equal to the number of gpus you have on your machine.
321
322
3. `torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate...`
323
A possible culprit is that your `--per-device-train-batch-size` is too high.
0 commit comments