Skip to content

Commit 66d5e5a

Browse files
authored
dmr: add update instructions for Engine (#23102)
1 parent 9e8032b commit 66d5e5a

File tree

1 file changed

+17
-5
lines changed

1 file changed

+17
-5
lines changed

content/manuals/ai/model-runner/_index.md

Lines changed: 17 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -40,21 +40,21 @@ with AI models locally.
4040
- Run and interact with AI models directly from the command line or from the Docker Desktop GUI
4141
- Manage local models and display logs
4242

43-
## Requirements
43+
## Requirements
4444

4545
Docker Model Runner is supported on the following platforms:
4646

4747
{{< tabs >}}
4848
{{< tab name="Windows">}}
4949

5050
Windows(amd64):
51-
- NVIDIA GPUs
51+
- NVIDIA GPUs
5252
- NVIDIA drivers 576.57+
5353

5454
Windows(arm64):
5555
- OpenCL for Adreno
5656
- Qualcomm Adreno GPU (6xx series and later)
57-
57+
5858
> [!NOTE]
5959
> Some llama.cpp features might not be fully supported on the 6xx series.
6060
@@ -142,6 +142,18 @@ You can now use the `docker model` command in the CLI and view and interact with
142142
- Comma-separated list of allowed origins
143143
- When unspecified, all origins are denied.
144144

145+
### Update DMR in Docker Engine
146+
147+
To update Docker Model Runner in Docker Engine, uninstall it with [`docker model uninstall-runner`](/reference/cli/docker/model/uninstall-runner/) then reinstall it:
148+
149+
```console
150+
docker model uninstall-runner --images && docker model install-runner
151+
```
152+
153+
> [!NOTE]
154+
> With the above command, local models are preserved.
155+
> To delete the models during the upgrade, add the `--models` option to the `uninstall-runner` command.
156+
145157
## Pull a model
146158

147159
Models are cached locally.
@@ -162,7 +174,7 @@ Models are cached locally.
162174
{{< tab name="From the Docker CLI">}}
163175

164176
Use the [`docker model pull` command](/reference/cli/docker/model/pull/). For example:
165-
177+
166178
```bash {title="Pulling from Docker Hub"}
167179
docker model pull ai/smollm2:360M-Q4_K_M
168180
```
@@ -294,7 +306,7 @@ Once the feature is enabled, new API endpoints are available under the following
294306
> The `172.17.0.1` interface may not be available by default to containers
295307
within a Compose project.
296308
> In this case, add an `extra_hosts` directive to your Compose service YAML:
297-
>
309+
>
298310
> ```yaml
299311
> extra_hosts:
300312
> - "model-runner.docker.internal:host-gateway"

0 commit comments

Comments
 (0)