Skip to content

Commit 6dd4d1f

Browse files
authored
add jina-v2-code up_gated_layer [no ci]
1 parent c09418b commit 6dd4d1f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

gguf-py/gguf/tensor_mapping.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -335,6 +335,7 @@ class TensorNameMap:
335335
"model.layers.{bid}.mlp.c_fc", # starcoder2
336336
"encoder.layer.{bid}.mlp.gated_layers_v", # jina-bert-v2 (split up/gate, no longer used)
337337
"encoder.layer.{bid}.mlp.gated_layers", # jina-bert-v2 (GEGLU)
338+
"encoder.layer.{bid}.mlp.up_gated_layer", # jina-v2-code (GEGLU)
338339
"model.layers.{bid}.residual_mlp.w3", # arctic
339340
"encoder.layers.{bid}.mlp.dense_h_to_4h", # chatglm
340341
"transformer.h.{bid}.mlp.c_fc_1", # exaone

0 commit comments

Comments
 (0)