Skip to content

Commit 50bd730

Browse files
authored
dmr hugging face addition (#22526)
<!--Delete sections as needed --> ## Description Add ability to pull from Hugging Face ## Related issues or tickets <!-- Related issues, pull requests, or Jira tickets --> ## Reviews <!-- Notes for reviewers here --> <!-- List applicable reviews (optionally @tag reviewers) --> - [ ] Technical review - [ ] Editorial review - [ ] Product review
1 parent 620d654 commit 50bd730

File tree

1 file changed

+16
-0
lines changed

1 file changed

+16
-0
lines changed

content/manuals/ai/model-runner.md

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -97,6 +97,22 @@ Model ai/smollm2 pulled successfully
9797

9898
The models also display in the Docker Desktop Dashboard.
9999

100+
#### Pull from Hugging Face
101+
102+
You can also pull GGUF models directly from [Hugging Face](https://huggingface.co/models?library=gguf).
103+
104+
```console
105+
$ docker model pull hf.co/<model-you-want-to-pull>
106+
```
107+
108+
For example:
109+
110+
```console
111+
$ docker model pull hf.co/bartowski/Llama-3.2-1B-Instruct-GGUF
112+
```
113+
114+
Pulls the [bartowski/Llama-3.2-1B-Instruct-GGUF](https://huggingface.co/bartowski/Llama-3.2-1B-Instruct-GGUF).
115+
100116
### List available models
101117

102118
Lists all models currently pulled to your local environment.

0 commit comments

Comments
 (0)