Skip to content

llama : use n_swa + n_ubatch cells for SWA cache#13833

Merged
ggerganov merged 2 commits intomasterfrom
gg/swa-optimize
May 31, 2025
Merged

llama : use n_swa + n_ubatch cells for SWA cache#13833
ggerganov merged 2 commits intomasterfrom
gg/swa-optimize

Commits

Commits on May 31, 2025