lmdeploy的设计是和vllm一样先来先服务（FCFS），后来先抢占，gpu不够就先swap到cpu上吗？ #2087

Closed

opened

on Jul 19, 2024

如果不是，请问可以去哪里看？源码指出位置也可以

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests