Skip to content

Commit ed53eca

Browse files
authored
Update distributed_inference.md to correct syntax
1 parent 6708f5c commit ed53eca

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

docs/source/en/training/distributed_inference.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -297,9 +297,9 @@ if __name__ == "__main__":
297297

298298
The script above needs to be run with a distributed launcher, such as [torchrun](https://docs.pytorch.org/docs/stable/elastic/run.html), that is compatible with PyTorch. `--nproc-per-node` is set to the number of GPUs available.
299299

300-
/```shell
301-
`torchrun --nproc-per-node 2 above_script.py`.
302-
/```
300+
```shell
301+
torchrun --nproc-per-node 2 above_script.py
302+
```
303303

304304
### Ulysses Attention
305305

@@ -332,4 +332,4 @@ transformer = AutoModel.from_pretrained(
332332
pipeline = DiffusionPipeline.from_pretrained(
333333
CKPT_ID, transformer=transformer, torch_dtype=torch.bfloat16,
334334
).to(device)
335-
```
335+
```

0 commit comments

Comments
 (0)