docker image for AMXInt8 #1395
Unanswered
dongshijiang
asked this question in
Q&A
Replies: 1 comment 1 reply
-
You can use my docker voipmonitor/inference-ktransformers which was built for 12.0 / sm_120 (blackwell) only |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
1、针对AMXInt8有没有可用的docker images;
2、如果没有相应的images,是不是可以提供一下运行环境或编译环境,比如cuda版本,pytorch版本,transformers版本,gcc版本,glibc版本等
Beta Was this translation helpful? Give feedback.
All reactions