Skip to content

Commit 07416e0

Browse files
sammcjCISC
andauthored
Update src/llama-model.cpp
Co-authored-by: Sigbjørn Skjæret <[email protected]>
1 parent 7c8fc01 commit 07416e0

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama-model.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13494,7 +13494,7 @@ struct llm_build_glm4_moe : public llm_graph_context {
1349413494

1349513495
// Only process up to last layer (skip final NextN layer)
1349613496
// Final layer tensors are loaded but not processed in forward pass
13497-
const int n_transformer_layers = n_layer - 1;
13497+
const int n_transformer_layers = n_layer - hparam.nextn_predict_layers;
1349813498
for (int il = 0; il < n_transformer_layers; ++il) {
1349913499
ggml_tensor * inpSA = inpL;
1350013500

0 commit comments

Comments
 (0)