Skip to content

kv-cache : better estimate of n_kv for multi-sequence batches#15610

Merged
ggerganov merged 1 commit intomasterfrom
gg/kv-cache-fix-n_kv
Aug 27, 2025
Merged

kv-cache : better estimate of n_kv for multi-sequence batches#15610
ggerganov merged 1 commit intomasterfrom
gg/kv-cache-fix-n_kv

Commits

Commits on Aug 27, 2025