Skip to content

Commit 9223146

Browse files
ikawrakowIwan Kawrakow
andauthored
Fix fused grouped topk (ikawrakow#851)
Co-authored-by: Iwan Kawrakow <[email protected]>
1 parent f5571e2 commit 9223146

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ggml/src/ggml-cuda.cu

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3187,7 +3187,7 @@ static bool ggml_cuda_compute_forward(ggml_backend_cuda_context & ctx, struct gg
31873187
cgraph->nodes[i+2]->op == GGML_OP_ADD &&
31883188
cgraph->nodes[i+3]->op == GGML_OP_GROUPED_TOPK &&
31893189
cgraph->nodes[i+4]->op == GGML_OP_GET_ROWS) {
3190-
cuda_bailingmoev2_experts(ctx, cgraph->nodes[i+4], cgraph->nodes[i+4]);
3190+
cuda_bailingmoev2_experts(ctx, cgraph->nodes[i+4], cgraph->nodes[i+3]);
31913191
i += 4;
31923192
} else {
31933193
ggml_cuda_op_sigmoid(ctx, dst);

0 commit comments

Comments
 (0)