LMDeploy AWQ #2776
Unanswered
sitabulaixizawaluduo
asked this question in
Q&A
LMDeploy AWQ
#2776
Replies: 1 comment
-
|
float16 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
AWQ反量化后的数据精度是自动用float16, 还是会根据config.json自适应为bfloat16或者float16
Beta Was this translation helpful? Give feedback.
All reactions