Skip to content

Commit 5d188e8

Browse files
JKSenthilfacebook-github-bot
authored andcommitted
support dp_mesh retrieval for hydra config compatibility (#1018)
Summary: Pull Request resolved: #1018 Reviewed By: galrotem Differential Revision: D79193080 fbshipit-source-id: f5e753d6cf494647bfb654b079c314db61b81e71
1 parent d501c48 commit 5d188e8

File tree

1 file changed

+13
-0
lines changed

1 file changed

+13
-0
lines changed

torchtnt/utils/device_mesh.py

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,19 @@ def tp_mesh(self) -> Optional[DeviceMesh]:
7979
return None
8080

8181

82+
def get_dp_mesh(global_mesh: GlobalMeshCoordinator) -> DeviceMesh:
83+
"""
84+
Retrieves the data parallel mesh from the global mesh coordinator.
85+
86+
Args:
87+
global_mesh (GlobalMeshCoordinator): The global mesh coordinator instance.
88+
89+
Returns:
90+
DeviceMesh: The data parallel mesh.
91+
"""
92+
return global_mesh.dp_mesh
93+
94+
8295
def get_dp_mesh_size(global_mesh: GlobalMeshCoordinator) -> int:
8396
"""
8497
Retrieves the size of the data parallel mesh from the global mesh coordinator.

0 commit comments

Comments
 (0)