Skip to content

Commit d9627a3

Browse files
committed
Update base for Update on "[Executorch] Add quantized kv cache to oss ci"
Fixes to make sure quantized kv cache works in oss Differential Revision: [D66269487](https://our.internmc.facebook.com/intern/diff/D66269487/) [ghstack-poisoned]
1 parent 524b9fe commit d9627a3

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

extension/llm/custom_ops/custom_ops.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,9 @@
2424
op2 = torch.ops.llama.fast_hadamard_transform.default
2525
assert op2 is not None
2626
except:
27-
libs = list(Path(__file__).parent.resolve().glob("libcustom_ops_aot_lib.*"))
27+
path = Path(__file__).parent.resolve()
28+
logging.info(f"Looking for libcustom_ops_aot_lib.so in {path}")
29+
libs = list(path.glob("libcustom_ops_aot_lib.*"))
2830
assert len(libs) == 1, f"Expected 1 library but got {len(libs)}"
2931
logging.info(f"Loading custom ops library: {libs[0]}")
3032
torch.ops.load_library(libs[0])

0 commit comments

Comments
 (0)