Skip to content

Commit 9a80a9c

Browse files
authored
change ernie-3.0-xbase-zh dropout to 0.1 (#2382)
1 parent 99673ad commit 9a80a9c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

paddlenlp/transformers/ernie/modeling.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -318,9 +318,9 @@ class ErniePretrainedModel(PretrainedModel):
318318
"pad_token_id": 0,
319319
},
320320
"ernie-3.0-xbase-zh": {
321-
"attention_probs_dropout_prob": 0.0,
321+
"attention_probs_dropout_prob": 0.1,
322322
"hidden_act": "gelu",
323-
"hidden_dropout_prob": 0.0,
323+
"hidden_dropout_prob": 0.1,
324324
"intermediate_size": 4096, # special for large model
325325
"hidden_size": 1024,
326326
"initializer_range": 0.02,

0 commit comments

Comments
 (0)