Skip to content

Commit 7dd5808

Browse files
committed
fix
Signed-off-by: Hemil Desai <hemild@nvidia.com>
1 parent 0a7d562 commit 7dd5808

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

nemo_rl/models/policy/__init__.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,7 @@ class AutomodelBackendConfig(TypedDict):
5555
# Use fake balanced gate for testing/debugging MoE
5656
fake_balanced_gate: NotRequired[bool]
5757
# Enable HuggingFace state dict adapter for checkpoint saving/loading plus refit support for RL
58+
# This should almost always be set to True when using a custom MoE implementation. Set to False only for specific use cases like debugging or performance testing.
5859
enable_hf_state_dict_adapter: NotRequired[bool]
5960
# Enable FSDP-specific optimizations
6061
enable_fsdp_optimizations: NotRequired[bool]

0 commit comments

Comments
 (0)