Skip to content

Include speculative decoding stats when timings_per_token is enabled#12603

Merged
ggerganov merged 3 commits intoggml-org:masterfrom
mostlygeek:master
Mar 28, 2025
Merged

Include speculative decoding stats when timings_per_token is enabled#12603
ggerganov merged 3 commits intoggml-org:masterfrom
mostlygeek:master

Commits

Commits on Mar 27, 2025