Skip to content

Commit 483cea5

Browse files
ikawrakowIwan Kawrakow
andauthored
Fix experts mul node name (ikawrakow#857)
Co-authored-by: Iwan Kawrakow <[email protected]>
1 parent 0e1d33c commit 483cea5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/llama-build-context.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -942,7 +942,7 @@ llm_expert_gating_func_type gating_op,
942942

943943
if (!weight_before_ffn) {
944944
experts = ggml_mul(ctx, experts, weights);
945-
cb(cur, "ffn_moe_weighted", il);
945+
cb(experts, "ffn_moe_weighted", il);
946946
}
947947

948948
if (n_expert_used == 1) {

0 commit comments

Comments
 (0)