Skip to content

Commit a273d54

Browse files
committed
Update on "[Executorch][llama] Rename update_quantized_cache to update_cache"
Because it is just really an inplace update op. Nothing special Differential Revision: [D66041160](https://our.internmc.facebook.com/intern/diff/D66041160/) [ghstack-poisoned]
2 parents dc357d9 + 39a5e26 commit a273d54

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

examples/models/llama/source_transformation/quantized_kv_cache.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -190,7 +190,6 @@ def update(self, input_pos, k_val, v_val):
190190
seq_length = k_val.size(dim_to_slice)
191191
narrowed_k = k_out.narrow(dim_to_slice, start_pos, seq_length)
192192
narrowed_k.copy_(k_val)
193-
# pyre-ignore: Incompatible parameter type [6]
194193
narrowed_v = v_out.narrow(dim_to_slice, start_pos, seq_length)
195194
narrowed_v.copy_(v_val)
196195
else:

0 commit comments

Comments
 (0)