[V1][Perf] Avoid mem duplication when aggregating MM tensors#16440

njhill wants to merge 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

njhill:mm-reduce-memnjhill/vllm:mm-reduce-memCopy head branch name to clipboard