Skip to content

Commit d77fc12

Browse files
aevesdockersarahsanders-dockercraig-osterhoutkiview
authored
publish updates from main (#22821)
Automated pull request for publishing docs updates. --------- Co-authored-by: Sarah Sanders <[email protected]> Co-authored-by: Craig Osterhout <[email protected]> Co-authored-by: Kevin Wittek <[email protected]> Co-authored-by: Allie Sadler <[email protected]> Co-authored-by: aevesdocker <[email protected]>
2 parents d55774d + 7a31d0c commit d77fc12

File tree

6 files changed

+344
-107
lines changed

6 files changed

+344
-107
lines changed

.markdownlint.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@
1313
"no-space-in-code": true,
1414
"no-space-in-links": true,
1515
"no-empty-links": true,
16-
"ol-prefix": {"style": "ordered"},
16+
"ol-prefix": {"style": "one_or_ordered"},
1717
"no-reversed-links": true,
1818
"reference-links-images": {
1919
"shortcut_syntax": false

content/manuals/ai/model-runner/_index.md

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -130,6 +130,36 @@ Use the [`docker model log` command](/reference/cli/docker/).
130130
{{< /tab >}}
131131
{{< /tabs >}}
132132

133+
## Publish a model
134+
135+
> [!NOTE]
136+
>
137+
> This works for any Container Registry supporting OCI Artifacts, not only Docker Hub.
138+
139+
You can tag existing models with a new name and publish them under a different namespace and repository:
140+
141+
```console
142+
# Tag a pulled model under a new name
143+
$ docker model tag ai/smollm2 myorg/smollm2
144+
145+
# Push it to Docker Hub
146+
$ docker model push myorg/smollm2
147+
```
148+
149+
For more details, see the [`docker model tag`](/reference/cli/docker/model/tag) and [`docker model push`](/reference/cli/docker/model/push) command documentation.
150+
151+
You can also directly package a model file in GGUF format as an OCI Artifact and publish it to Docker Hub.
152+
153+
```console
154+
# Download a model file in GGUF format, e.g. from HuggingFace
155+
$ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf
156+
157+
# Package it as OCI Artifact and push it to Docker Hub
158+
$ docker model package --gguf "$(pwd)/model.gguf" --push myorg/mistral-7b-v0.1:Q4_K_M
159+
```
160+
161+
For more details, see the [`docker model package`](/reference/cli/docker/model/package/) command documentation.
162+
133163
## Example: Integrate Docker Model Runner into your software development lifecycle
134164

135165
You can now start building your Generative AI application powered by the Docker Model Runner.

0 commit comments

Comments
 (0)