Skip to content

Commit 082b308

Browse files
committed
Update on "[Executorch] Add quantized kv cache to oss ci"
Fixes to make sure quantized kv cache works in oss Differential Revision: [D66269487](https://our.internmc.facebook.com/intern/diff/D66269487/) [ghstack-poisoned]
2 parents 6f1efc5 + 895fe12 commit 082b308

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

kernels/quantized/__init__.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@
99
try:
1010
import glob
1111

12-
import torch
12+
import torch as _torch
1313
import executorch
1414

1515
# Ideally package is installed in only one location but usage of
@@ -23,7 +23,8 @@
2323
)
2424
assert len(libs) == 1, f"Expected 1 library but got {len(libs)}"
2525
logging.info(f"Loading custom ops library: {libs[0]}")
26-
torch.ops.load_library(libs[0])
26+
_torch.ops.load_library(libs[0])
27+
del _torch
2728
except:
2829
import logging
2930

0 commit comments

Comments
 (0)