Skip to content

Commit 557b7ec

Browse files
authored
fix: moonlight CI test mem regression (increase cache flush) (#1257)
Signed-off-by: Terry Kong <[email protected]>
1 parent 376e625 commit 557b7ec

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

examples/configs/recipes/llm/grpo-moonlight-16ba3b-4n8g-megatron.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,7 @@ policy:
2222
optimizer: null
2323
megatron_cfg:
2424
enabled: true
25+
empty_unused_memory_level: 1
2526
expert_model_parallel_size: 4
2627
pipeline_model_parallel_size: 4
2728
num_layers_in_first_pipeline_stage: 7

0 commit comments

Comments
 (0)