[Feature] Add per-request attention capture to the OpenAI-compatible API#35014
Open
Parkprogrammer wants to merge 3 commits intovllm-project:mainfrom
Open
[Feature] Add per-request attention capture to the OpenAI-compatible API#35014Parkprogrammer wants to merge 3 commits intovllm-project:mainfrom
Parkprogrammer wants to merge 3 commits intovllm-project:mainfrom