Feature/intermediates cache prefetch#2392

Merged

HDCharles merged 4 commits intovllm-project:mainfrom

GOavi101:feature/intermediates-cache-prefetch

Mar 17, 2026

Commits on Feb 21, 2026

Add optional prefetch to intermediates cache; enable for AWQ when offloading
Avishek Goswami
committed

Commits on Mar 5, 2026

Add optional prefetch to intermediates cache; enable for AWQ when offloading
Avishek Goswami
committed

Commits on Mar 17, 2026

Address review: move deep_equal, make prefetch a global setting via State
Avishek Goswami
committed
Merge branch 'main' into feature/intermediates-cache-prefetch
HDCharles
authored