Skip to content

Commit e732e34

Browse files
RecML authorsrecml authors
authored andcommitted
Fix bug in HSTU residual.
PiperOrigin-RevId: 747769363
1 parent 45d64b7 commit e732e34

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

recml/layers/keras/hstu.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -471,7 +471,7 @@ def call(
471471
gated_attn_output = u * normed_attn_output
472472

473473
out = self._output_dense(gated_attn_output)
474-
return out + normed_inputs
474+
return out + inputs
475475

476476
def get_config(self) -> dict[str, Any]:
477477
return {

0 commit comments

Comments
 (0)