Skip to content

Commit dd221bd

Browse files
committed
update readme (2)
1 parent 723d77c commit dd221bd

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -245,6 +245,8 @@ The [Hugging Face](https://huggingface.co) platform hosts a [number of LLMs](htt
245245
- [Trending](https://huggingface.co/models?library=gguf&sort=trending)
246246
- [LLaMA](https://huggingface.co/models?sort=trending&search=llama+gguf)
247247

248+
You can either manually download the GGUF file or directly use any `llama.cpp`-compatible models from Hugging Face by using this CLI argument: `-hf <user>/<model>[:quant]`
249+
248250
After downloading a model, use the CLI tools to run it locally - see below.
249251

250252
`llama.cpp` requires the model to be stored in the [GGUF](https://github.com/ggerganov/ggml/blob/master/docs/gguf.md) file format. Models in other data formats can be converted to GGUF using the `convert_*.py` Python scripts in this repo.

0 commit comments

Comments
 (0)