Commit f0361f3
local-apps: update
This PR updates the code snippet of `node-llama-cpp` to use a tag-based
model URI, like in `llama.cpp` and Ollama.
The implementation for this uses the Ollama support on Hugging Face, and
is based on this PR: ggml-org/llama.cpp#11195
Examples:
```bash
# chat with the model
npx -y node-llama-cpp chat hf:mradermacher/Llama-3.2-3B-Instruct-GGUF:Q4_K_M
# estimate the model compatibility with the current machine hardware
npx -y node-llama-cpp inspect estimate hf:mradermacher/Llama-3.2-3B-Instruct-GGUF:Q4_K_M
```
Co-authored-by: Xuan-Son Nguyen <[email protected]>node-llama-cpp snippet (#1169)1 parent 34edae3 commit f0361f3
1 file changed
+9
-6
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
138 | 138 | | |
139 | 139 | | |
140 | 140 | | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
141 | 148 | | |
142 | 149 | | |
143 | 150 | | |
144 | | - | |
145 | | - | |
146 | | - | |
147 | | - | |
148 | | - | |
| 151 | + | |
149 | 152 | | |
150 | 153 | | |
151 | 154 | | |
152 | | - | |
| 155 | + | |
153 | 156 | | |
154 | 157 | | |
155 | 158 | | |
| |||
0 commit comments