Skip to content

Commit bb0b4db

Browse files
committed
electra config: reset the vocab size to previous default value for scope
- the vocab size was increased for proteins in commit a12354b - as we are going to move protein related code to new repo, revert this to original value
1 parent 158d6f3 commit bb0b4db

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

configs/model/electra.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ init_args:
33
optimizer_kwargs:
44
lr: 1e-3
55
config:
6-
vocab_size: 8500
6+
vocab_size: 1400
77
max_position_embeddings: 1800
88
num_attention_heads: 8
99
num_hidden_layers: 6

0 commit comments

Comments
 (0)