Skip to content

Commit 7a31d0c

Browse files
kiviewaevesdocker
andauthored
docs: add model publishing instructions to the Docker Model Runner docs (#22819)
## Description - Introduced a new section on publishing models, including tagging and pushing to Docker Hub. - Added examples for tagging existing models and packaging GGUF format models as OCI Artifacts. - Clarified that the functionality supports any Container Registry compatible with OCI Artifacts. --------- Co-authored-by: Allie Sadler <[email protected]> Co-authored-by: aevesdocker <[email protected]>
1 parent edd8605 commit 7a31d0c

File tree

1 file changed

+30
-0
lines changed

1 file changed

+30
-0
lines changed

content/manuals/ai/model-runner/_index.md

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -129,6 +129,36 @@ Use the [`docker model log` command](/reference/cli/docker/).
129129
{{< /tab >}}
130130
{{< /tabs >}}
131131

132+
## Publish a model
133+
134+
> [!NOTE]
135+
>
136+
> This works for any Container Registry supporting OCI Artifacts, not only Docker Hub.
137+
138+
You can tag existing models with a new name and publish them under a different namespace and repository:
139+
140+
```console
141+
# Tag a pulled model under a new name
142+
$ docker model tag ai/smollm2 myorg/smollm2
143+
144+
# Push it to Docker Hub
145+
$ docker model push myorg/smollm2
146+
```
147+
148+
For more details, see the [`docker model tag`](/reference/cli/docker/model/tag) and [`docker model push`](/reference/cli/docker/model/push) command documentation.
149+
150+
You can also directly package a model file in GGUF format as an OCI Artifact and publish it to Docker Hub.
151+
152+
```console
153+
# Download a model file in GGUF format, e.g. from HuggingFace
154+
$ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf
155+
156+
# Package it as OCI Artifact and push it to Docker Hub
157+
$ docker model package --gguf "$(pwd)/model.gguf" --push myorg/mistral-7b-v0.1:Q4_K_M
158+
```
159+
160+
For more details, see the [`docker model package`](/reference/cli/docker/model/package/) command documentation.
161+
132162
## Example: Integrate Docker Model Runner into your software development lifecycle
133163

134164
You can now start building your Generative AI application powered by the Docker Model Runner.

0 commit comments

Comments
 (0)