Replies: 1 comment 3 replies
-
|
这个可以帮忙回答一下吗？ |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
vllm目前应该是recompute的方法，swap到cpu上会很影响性能 |
Beta Was this translation helpful? Give feedback.
-
|
lmdeploy一直都是recompute |
Beta Was this translation helpful? Give feedback.
-
|
谢谢 |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
如果不是，请问可以去哪里看？源码指出位置也可以
Beta Was this translation helpful? Give feedback.
All reactions