Use KV cache constant names provided by compressed tensors #1200

kylesayrs merged 5 commits intomainvllm-project/llm-compressor:mainfrom

kylesayrs/kv-use-constantsvllm-project/llm-compressor:kylesayrs/kv-use-constantsCopy head branch name to clipboard