2颗cpu支持amx+1T的ddr5的内存+8块*4090显卡，使用0.2.4版本的Ktransformers #1153
Replies: 1 comment
-
|
上面的配置能否做到商用 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
2颗cpu支持amx+1T的ddr5的内存+8块*4090显卡，使用0.2.4版本的Ktransformers
并发和tokens/s，能做到什么程度呢，如何优化 deepseek-r Q4 的模型
Beta Was this translation helpful? Give feedback.
All reactions