File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -102,7 +102,7 @@ Here are recommended settings, depending on the amount of VRAM that you have:
102102 ``` bash
103103 llama-server \
104104 -hf ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF \
105- --port 8012 -ngl 99 -fa -ub 1024 -b 1024 -dt 0.1 \
105+ --port 8012 -ngl 99 -fa -ub 1024 -b 1024 \
106106 --ctx-size 0 --cache-reuse 256
107107 ```
108108
@@ -111,7 +111,7 @@ Here are recommended settings, depending on the amount of VRAM that you have:
111111 ``` bash
112112 llama-server \
113113 -hf ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF \
114- --port 8012 -ngl 99 -fa -ub 1024 -b 1024 -dt 0.1 \
114+ --port 8012 -ngl 99 -fa -ub 1024 -b 1024 \
115115 --ctx-size 0 --cache-reuse 256
116116 ```
117117
@@ -120,7 +120,7 @@ Here are recommended settings, depending on the amount of VRAM that you have:
120120 ``` bash
121121 llama-server \
122122 -hf ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF \
123- --port 8012 -ngl 99 -fa -ub 1024 -b 1024 -dt 0.1 \
123+ --port 8012 -ngl 99 -fa -ub 1024 -b 1024 \
124124 --ctx-size 0 --cache-reuse 256
125125 ```
126126
You can’t perform that action at this time.
0 commit comments