Skip to content

Commit cdf9a07

Browse files
committed
docs: add model publishing instructions to the Docker Model Runner manual
- Introduced a new section on publishing models, including tagging and pushing to Docker Hub. - Added examples for tagging existing models and packaging GGUF format models as OCI Artifacts. - Clarified that the functionality supports any Container Registry compatible with OCI Artifacts.
1 parent 73b3fa9 commit cdf9a07

File tree

1 file changed

+27
-0
lines changed

1 file changed

+27
-0
lines changed

content/manuals/ai/model-runner/_index.md

Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -129,6 +129,33 @@ Use the [`docker model log` command](/reference/cli/docker/).
129129
{{< /tab >}}
130130
{{< /tabs >}}
131131

132+
## Publishing models
133+
134+
You can tag existing models with a new name and publish them under a different namespace and repository:
135+
136+
```console
137+
# Tag a pulled model under a new name
138+
$ docker model tag ai/smollm2 myorg/smollm2
139+
140+
# Push it to Docker Hub
141+
$ docker model push myorg/smollm2
142+
```
143+
144+
See the [`docker model tag`](/reference/cli/docker/model/tag) and [`docker model push`](/reference/cli/docker/model/push) command documentation for more details.
145+
Note: This works for any Container Registry supporting OCI Artifacts, not only Docker Hub.
146+
147+
You can also directly package a model file in GGUF format as an OCI Artifact and publish it to Docker Hub
148+
149+
```console
150+
# Download a model file in GGUF format, e.g. from HuggingFace
151+
$ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf
152+
153+
# Package it as OCI Artifact and push it to Docker Hub
154+
$ docker model package --gguf "$(pwd)/model.gguf" --push myorg/mistral-7b-v0.1:Q4_K_M
155+
```
156+
157+
See the [`docker model package`](/reference/cli/docker/model/package/) command documentation for more details.
158+
132159
## Example: Integrate Docker Model Runner into your software development lifecycle
133160

134161
You can now start building your Generative AI application powered by the Docker Model Runner.

0 commit comments

Comments
 (0)