-
Notifications
You must be signed in to change notification settings - Fork 8.1k
docs: add model publishing instructions to the Docker Model Runner docs #22819
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 1 commit
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -129,6 +129,33 @@ Use the [`docker model log` command](/reference/cli/docker/). | |
| {{< /tab >}} | ||
| {{< /tabs >}} | ||
|
|
||
| ## Publishing models | ||
|
|
||
| You can tag existing models with a new name and publish them under a different namespace and repository: | ||
|
|
||
| ```console | ||
| # Tag a pulled model under a new name | ||
| $ docker model tag ai/smollm2 myorg/smollm2 | ||
|
|
||
| # Push it to Docker Hub | ||
| $ docker model push myorg/smollm2 | ||
| ``` | ||
|
|
||
| See the [`docker model tag`](/reference/cli/docker/model/tag) and [`docker model push`](/reference/cli/docker/model/push) command documentation for more details. | ||
kiview marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| Note: This works for any Container Registry supporting OCI Artifacts, not only Docker Hub. | ||
|
||
|
|
||
| You can also directly package a model file in GGUF format as an OCI Artifact and publish it to Docker Hub | ||
kiview marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ```console | ||
| # Download a model file in GGUF format, e.g. from HuggingFace | ||
| $ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf | ||
|
|
||
| # Package it as OCI Artifact and push it to Docker Hub | ||
| $ docker model package --gguf "$(pwd)/model.gguf" --push myorg/mistral-7b-v0.1:Q4_K_M | ||
| ``` | ||
|
|
||
| See the [`docker model package`](/reference/cli/docker/model/package/) command documentation for more details. | ||
kiview marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ## Example: Integrate Docker Model Runner into your software development lifecycle | ||
|
|
||
| You can now start building your Generative AI application powered by the Docker Model Runner. | ||
|
|
||
Uh oh!
There was an error while loading. Please reload this page.