Skip to content

Commit 4790efe

Browse files
committed
Delete norm_first option
1 parent b654e4f commit 4790efe

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

configs/delta_net_340M.json

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,6 @@
1313
"intermediate_size": null,
1414
"model_type": "delta_net",
1515
"norm_eps": 1e-06,
16-
"norm_first": false,
1716
"num_heads": 8,
1817
"num_hidden_layers": 24,
1918
"qk_activation": "silu",

0 commit comments

Comments
 (0)