Skip to content

Commit 740945b

Browse files
committed
update: adan recipe
1 parent c5741f8 commit 740945b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/test_optimizers.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@
8181
(Nero, {'lr': 5e-1}, 200),
8282
(Nero, {'lr': 5e-1, 'constraints': False}, 200),
8383
(Adan, {'lr': 2e-1}, 200),
84-
(Adan, {'lr': 2e-1, 'weight_decay': 1e-4, 'use_gc': True}, 500),
84+
(Adan, {'lr': 1e-0, 'weight_decay': 1e-3, 'use_gc': True}, 500),
8585
]
8686

8787
ADAMD_SUPPORTED_OPTIMIZERS: List[Tuple[Any, Dict[str, Union[float, bool, int]], int]] = [

0 commit comments

Comments
 (0)