[Perf][Qwen3-TTS] Vectorize _LocalPredictorKVCache to eliminate per-token loops#1581
Draft
gcanlin wants to merge 1 commit intovllm-project:mainfrom
Draft
[Perf][Qwen3-TTS] Vectorize _LocalPredictorKVCache to eliminate per-token loops#1581gcanlin wants to merge 1 commit intovllm-project:mainfrom
gcanlin wants to merge 1 commit intovllm-project:mainfrom
