Fix KV cache calibration for attention modules not named self_attn#2477
Open
changjonathanc wants to merge 3 commits intovllm-project:mainfrom
Open
Fix KV cache calibration for attention modules not named self_attn#2477changjonathanc wants to merge 3 commits intovllm-project:mainfrom
changjonathanc wants to merge 3 commits intovllm-project:mainfrom
