Skip to content

Commit 4da868f

Browse files
committed
Fix by replacing view with reshape
1 parent 827c3e1 commit 4da868f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

megatron/model/transformer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -312,7 +312,7 @@ def forward(self, query_layer, key_layer,
312312
value_layer.size(3))
313313

314314
# change view [sk, b * np, hn]
315-
value_layer = value_layer.view(value_layer.size(0),
315+
value_layer = value_layer.reshape(value_layer.size(0),
316316
output_size[0] * output_size[1], -1)
317317

318318
# change view [b * np, sq, sk]

0 commit comments

Comments
 (0)