File tree Expand file tree Collapse file tree 1 file changed +3
-1
lines changed
posts/02-09-25-torch-distributed Expand file tree Collapse file tree 1 file changed +3
-1
lines changed Original file line number Diff line number Diff line change @@ -175,7 +175,8 @@ <h3> Initialization </h3>
175175 Finally, once your distributed job is complete, you need to terminate the process group by calling:
176176 </ p >
177177
178- < pre > < code > torch.distributed.destroy_process_group()</ code > </ pre >
178+ < pre > < code class ="language-python "> torch.distributed.destroy_process_group()
179+ </ code > </ pre >
179180
180181 < p >
181182 This cleans up the communication resources and ensures that all processes exit gracefully.
@@ -499,6 +500,7 @@ <h3> Broadcasting Weights </h3>
499500if torch.distributed.get_rank() == 0:
500501 print(tokenizer.batch_decode(completions, skip_special_tokens=False))
501502
503+
502504torch.distributed.destroy_process_group()
503505
504506</ code > </ pre >
You can’t perform that action at this time.
0 commit comments