Skip to content

Commit 4746845

Browse files
committed
fix register, implement all proj and cls_head configurations for model init/reset, fix fused_attn
1 parent 936d20e commit 4746845

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

timm/models/pe.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -479,7 +479,7 @@ def __init__(
479479
else:
480480
self.attn_pool = None
481481

482-
self.act_layer_cfg = act_layer
482+
self.head_act_layer = None # =act_layer if to add an additional activation between fc1(proj) and fc2(head)
483483
self.init_tensors()
484484

485485
def init_tensors(self):

0 commit comments

Comments
 (0)