Add sequential_weight_offload_device to skip unnecessary weight offloading#2478
Closed
changjonathanc wants to merge 2 commits intovllm-project:mainfrom
Closed
Add sequential_weight_offload_device to skip unnecessary weight offloading#2478changjonathanc wants to merge 2 commits intovllm-project:mainfrom
changjonathanc wants to merge 2 commits intovllm-project:mainfrom
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?v=4&size=32){kind=avatar}