Skip to content

Commit 2153770

Browse files
minor
1 parent a5b6c77 commit 2153770

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

posts/02-09-25-torch-distributed/index.html

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -175,7 +175,8 @@ <h3> Initialization </h3>
175175
Finally, once your distributed job is complete, you need to terminate the process group by calling:
176176
</p>
177177

178-
<pre><code>torch.distributed.destroy_process_group()</code></pre>
178+
<pre><code class="language-python">torch.distributed.destroy_process_group()
179+
</code></pre>
179180

180181
<p>
181182
This cleans up the communication resources and ensures that all processes exit gracefully.
@@ -499,6 +500,7 @@ <h3> Broadcasting Weights </h3>
499500
if torch.distributed.get_rank() == 0:
500501
print(tokenizer.batch_decode(completions, skip_special_tokens=False))
501502

503+
502504
torch.distributed.destroy_process_group()
503505

504506
</code></pre>

0 commit comments

Comments
 (0)