Skip to content

Commit 6e7a2f7

Browse files
cp: fix: grad norm check for automodel gpt oss nightly (1708) into r0.5.0 (#1711)
Signed-off-by: Hemil Desai <hemild@nvidia.com> Signed-off-by: NeMo Bot <nemo-bot@nvidia.com> Co-authored-by: Hemil Desai <hemild@nvidia.com>
1 parent 0fef58c commit 6e7a2f7

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tests/test_suites/llm/sft-gpt-oss-20b-1n8g-fsdp8ep8-automodel.sh

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,5 +36,6 @@ if [[ $(jq 'to_entries | .[] | select(.key == "train/loss") | .value | keys | ma
3636
uv run tests/check_metrics.py $JSON_METRICS \
3737
'data["train/loss"]["1"] < 7.0' \
3838
'data["train/loss"]["50"] < 0.4' \
39-
'data["train/grad_norm"]["50"] < 2.5'
39+
'data["train/grad_norm"]["50"] < 17.5' \
40+
'data["train/grad_norm"]["50"] > 10.0'
4041
fi

0 commit comments

Comments
 (0)