Skip to content

Commit 42ad61a

Browse files
committed
Update on "[Executorch] Add quantized kv cache to oss ci"
Fixes to make sure quantized kv cache works in oss Differential Revision: [D66269487](https://our.internmc.facebook.com/intern/diff/D66269487/) [ghstack-poisoned]
2 parents 1e2b684 + 4b6444c commit 42ad61a

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

examples/models/llama/source_transformation/quantized_kv_cache.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -227,6 +227,7 @@ def replace_kv_cache_with_quantized_kv_cache(module):
227227
assert op is not None
228228
except:
229229
import glob
230+
230231
import executorch
231232
from executorch.extension.pybindings import portable_lib # noqa # usort: skip
232233

0 commit comments

Comments
 (0)