Skip to content

Commit f48c045

Browse files
author
Beat Buesser
committed
Fix learning rate decay in EAD
Signed-off-by: Beat Buesser <[email protected]>
1 parent 57cb73b commit f48c045

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

art/attacks/evasion/elastic_net.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -190,7 +190,7 @@ def _decay_learning_rate(self, global_step: int, end_learning_rate: float, decay
190190
:return: The decayed learning rate
191191
"""
192192
learn_rate = self.learning_rate - end_learning_rate
193-
decayed_learning_rate = learn_rate * (1 - global_step / decay_steps) ** 2 + end_learning_rate
193+
decayed_learning_rate = learn_rate * (1 - global_step / decay_steps) ** 0.5 + end_learning_rate
194194

195195
return decayed_learning_rate
196196

0 commit comments

Comments
 (0)