Skip to content

Commit 6a147b7

Browse files
mmz33JackTemaki
authored andcommitted
fix logits dropout bug
1 parent dcf0381 commit 6a147b7

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

i6_models/decoder/attention.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -201,8 +201,8 @@ def forward(
201201
readout_in = readout_in.view(readout_in.size(0), readout_in.size(1), -1, 2) # [B,N,D/2,2]
202202
readout, _ = torch.max(readout_in, dim=-1) # [B,N,D/2]
203203

204-
output = self.output(readout)
205-
decoder_logits = self.output_dropout(output)
204+
readout_drop = self.output_dropout(readout)
205+
decoder_logits = self.output(readout_drop)
206206

207207
state = lstm_state, att_context, accum_att_weights
208208

0 commit comments

Comments
 (0)