Skip to content

Commit fa75cc0

Browse files
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
1 parent ce2313a commit fa75cc0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/fabric/tensor_parallel/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
## Tensor Parallel and 2D Parallel
2-
2+
33
This example shows how to apply tensor-parallelism to your model (here Llama 3 7B) with the `ModelParallelStrategy`, and how it can be combined with FSDP (2D parallelism).
44
PyTorch 2.3+ and a machine with at least 4 GPUs and 24 GB memory each are required to run this example.
55

0 commit comments

Comments
 (0)