We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent da623fd commit 11b5cc8Copy full SHA for 11b5cc8
docs/backend/CANN.md
@@ -119,6 +119,7 @@ The llama.cpp CANN backend is designed to support Ascend NPU. It utilize the abi
119
120
121
### Multimodal
122
+| Model Name | FP16 | Q4_0 | Q8_0 |
123
|:----------------------------|:-----:|:----:|:----:|
124
| LLaVA 1.5 models, LLaVA 1.6 models | x | x | x |
125
| BakLLaVA | √ | √ | √ |
0 commit comments