Skip to content

Commit 3f75e3d

Browse files
committed
remove unused mask variable
1 parent 41ff413 commit 3f75e3d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/models/llama/llama_transformer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -474,7 +474,7 @@ def forward(
474474

475475
if self.decode_kv_cache_as_io:
476476
assert self.use_kv_cache
477-
mask = self.mask[None, None, input_pos]
477+
# mask = self.mask[None, None, input_pos]
478478
if self.use_additive_kv_cache_update:
479479
assert cache_pos_mask is not None
480480
assert seqlen == 1

0 commit comments

Comments
 (0)