Skip to content

Commit b39b8a7

Browse files
committed
Update on "[Executorch] Add quantized kv cache to oss ci"
Fixes to make sure quantized kv cache works in oss Differential Revision: [D66269487](https://our.internmc.facebook.com/intern/diff/D66269487/) [ghstack-poisoned]
2 parents b015d80 + a2de105 commit b39b8a7

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

examples/models/llama/source_transformation/quantized_kv_cache.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -248,7 +248,6 @@ def from_float(cls, kv_cache, cache_type: QuantizedCacheType):
248248

249249
def replace_kv_cache_with_quantized_kv_cache(module):
250250
# This is needed to ensure that custom ops are registered
251-
from executorch.extension.pybindings import portable_lib # noqa # usort: skip
252251
from executorch.extension.llm.custom_ops import custom_ops # noqa: F401
253252

254253
logging.warning(

0 commit comments

Comments
 (0)