Skip to content

Conversation

msaroufim
Copy link
Member

@msaroufim msaroufim commented Aug 25, 2025

All these examples have warnings of the below sort

[rank0]:[W825 13:09:39.967659278 ProcessGroupNCCL.cpp:1538] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
(create) ➜  tensor_parallelism git:(main) ✗ CUDA_VISIBLE_DEVICES=4,5,6,7 torchrun --nnodes=1 --nproc_per_node=4 tensor_parallel_example.py

I don't think they're "dangerous" since people seem to ignore them just fine so this is just to be nice

Copy link

netlify bot commented Aug 25, 2025

Deploy Preview for pytorch-examples-preview canceled.

Name Link
🔨 Latest commit 6079ce6
🔍 Latest deploy log https://app.netlify.com/projects/pytorch-examples-preview/deploys/68acc4de35f8dc0008c811d7

@meta-cla meta-cla bot added the cla signed label Aug 25, 2025
@msaroufim msaroufim merged commit 77f55b9 into main Aug 25, 2025
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant