Skip to content

feat(candle-nn) ConcatKvCache for 2-5x GPU speedup on autoregressive generation#3143

Merged
ivarflakstad merged 21 commits intohuggingface:mainfrom
DrJesseGlass:concate_cache/qwen3
Nov 14, 2025
Merged

feat(candle-nn) ConcatKvCache for 2-5x GPU speedup on autoregressive generation#3143
ivarflakstad merged 21 commits intohuggingface:mainfrom
DrJesseGlass:concate_cache/qwen3

Commits

Commits on Oct 21, 2025

Commits on Oct 28, 2025

Commits on Nov 11, 2025

Commits on Nov 13, 2025