We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 2f26c4b commit c75a37eCopy full SHA for c75a37e
README.md
@@ -105,10 +105,9 @@ IMPORTANCE_MATRIX_DIRECTORY=.\imatrix
105
# Hint: A very good quantization with minimal quality loss is
106
# Q5_K_M. Quantization below 4-bit causes measurable quality
107
# loss, try to avoid going too low and use IQ4_XS as a minimum.
108
-#
109
# @see https://github.com/ggerganov/llama.cpp/tree/master/examples/perplexity
110
#
111
-QUANTIZATION_TYPES=Q5_K_M,Q4_1,Q3_K_S
+QUANTIZATION_TYPES=Q5_K_M,IQ4_XS
112
```
113
114
> [!NOTE]
0 commit comments