Skip to content

Commit 9d076c9

Browse files
committed
set _supports_sdpa = True in BertPreTrainedModel
1 parent 61908a1 commit 9d076c9

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/cehrbert/models/hf_models/hf_cehrbert.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -171,6 +171,7 @@ class CehrBertPreTrainedModel(PreTrainedModel):
171171
is_parallelizable = False
172172
supports_gradient_checkpointing = True
173173
_no_split_modules = ["BertLayer"]
174+
_supports_sdpa = True
174175

175176
def _init_weights(self, module):
176177
"""Initialize the weights."""

0 commit comments

Comments
 (0)