[work in progress] support for kv_cache#322

Draft

bigximik wants to merge 3 commits intomainfrom

Commits on Jul 1, 2025

added extra slow generate with cache test
bigximik
committed

Commits on Jul 4, 2025

Merge branch 'main' of github.com:ServiceNow/Fast-LLM into denis/kv_cache
bigximik
committed
added manual generate with cache test for development
bigximik
committed