Skip to content

Commit c1a6e1b

Browse files
committed
skip embedding for coreml
1 parent ddc8ea6 commit c1a6e1b

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

extension/llm/export/partitioner_lib.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -142,6 +142,11 @@ def _validate_ios_version() -> None:
142142
return CoreMLPartitioner( # pyre-fixme[16]
143143
compile_specs=compile_specs,
144144
take_over_mutable_buffer=take_over_mutable_buffer,
145+
# Skip embe
146+
skip_ops_for_coreml_delegation=[
147+
"quantized_decomposed.embedding_4bit.dtype",
148+
"aten.embedding.default",
149+
],
145150
)
146151

147152

0 commit comments

Comments
 (0)