Skip to content

Commit 4d922e8

Browse files
committed
Add backticks to mask'shape
1 parent f42c0e9 commit 4d922e8

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

labml_nn/transformers/alibi/__init__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -158,7 +158,7 @@ def forward(self, *,
158158

159159
# Create AliBi biases if it's not cached
160160
if self.alibi_biases is None or self.alibi_biases.shape[1] < seq_len:
161-
# `mask` has shape [seq_len, seq_len, 1, 1]
161+
# `mask` has shape `[seq_len, seq_len, 1, 1]`
162162
self.alibi_biases = get_alibi_biases(scores.shape[-1], mask[:, :, 0, 0])
163163

164164
# Add AliBi biases to attention scores.

0 commit comments

Comments
 (0)