UUID based caching optimization#2

vincentzed wants to merge 1 commit intomainvincentzed/vllm:mainfrom

uuid-based-caching-optimizationvincentzed/vllm:uuid-based-caching-optimizationCopy head branch name to clipboard