Skip to content

Commit 3d87b72

Browse files
author
Sanggyu Lee
committed
remove @torch.library.impl("circle::attention.llama", "CPU")
library.implf for "CPU" turned out not necessary.
1 parent 315d62a commit 3d87b72

File tree

1 file changed

+0
-19
lines changed

1 file changed

+0
-19
lines changed

tico/serialize/operators/onert/op_attention.py

Lines changed: 0 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -51,25 +51,6 @@
5151

5252
from typing import List, Optional
5353

54-
55-
@torch.library.impl("circle::attention.llama", "CPU")
56-
def attention_llama_cpu(
57-
hidden_states,
58-
q_proj,
59-
k_proj,
60-
v_proj,
61-
o_proj,
62-
position_cos,
63-
position_sin,
64-
attention_mask,
65-
past_key,
66-
past_value,
67-
layer_idx,
68-
cache_position,
69-
):
70-
return hidden_states
71-
72-
7354
@torch.library.register_fake("circle::attention.llama")
7455
def attention_llama(*args, **kwargs):
7556
(

0 commit comments

Comments
 (0)