Replies: 1 comment 1 reply
-
I think it is nice that torchrun automatically modifies the system setting for better performance and creates a warning message to notify the user. what's not working with multi-node? |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Describe the bug
Running Auto3d I get warning of
we should smartly export this variable before the torchrun
I tired exporting it myself but this doesn't work with multiple nodes. I think this parameter needs to be set in the python code itself
Beta Was this translation helpful? Give feedback.
All reactions