Skip to content

Commit 3c6391e

Browse files
authored
speculative-simple : free batch on exit (#17985)
1 parent 8e4d678 commit 3c6391e

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

examples/speculative-simple/speculative-simple.cpp

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -255,6 +255,8 @@ int main(int argc, char ** argv) {
255255
LOG_INF("target:\n\n");
256256
common_perf_print(ctx_tgt, smpl);
257257

258+
llama_batch_free(batch_tgt);
259+
258260
common_sampler_free(smpl);
259261
common_speculative_free(spec);
260262

0 commit comments

Comments
 (0)