You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/manuals/ai/model-runner/_index.md
+17-5Lines changed: 17 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -40,21 +40,21 @@ with AI models locally.
40
40
- Run and interact with AI models directly from the command line or from the Docker Desktop GUI
41
41
- Manage local models and display logs
42
42
43
-
## Requirements
43
+
## Requirements
44
44
45
45
Docker Model Runner is supported on the following platforms:
46
46
47
47
{{< tabs >}}
48
48
{{< tab name="Windows">}}
49
49
50
50
Windows(amd64):
51
-
- NVIDIA GPUs
51
+
- NVIDIA GPUs
52
52
- NVIDIA drivers 576.57+
53
53
54
54
Windows(arm64):
55
55
- OpenCL for Adreno
56
56
- Qualcomm Adreno GPU (6xx series and later)
57
-
57
+
58
58
> [!NOTE]
59
59
> Some llama.cpp features might not be fully supported on the 6xx series.
60
60
@@ -142,6 +142,18 @@ You can now use the `docker model` command in the CLI and view and interact with
142
142
- Comma-separated list of allowed origins
143
143
- When unspecified, all origins are denied.
144
144
145
+
### Update DMR in Docker Engine
146
+
147
+
To update Docker Model Runner in Docker Engine, uninstall it with [`docker model uninstall-runner`](/reference/cli/docker/model/uninstall-runner/) then reinstall it:
148
+
149
+
```console
150
+
docker model uninstall-runner --images && docker model install-runner
151
+
```
152
+
153
+
> [!NOTE]
154
+
> With the above command, local models are preserved.
155
+
> To delete the models during the upgrade, add the `--models` option to the `uninstall-runner` command.
156
+
145
157
## Pull a model
146
158
147
159
Models are cached locally.
@@ -162,7 +174,7 @@ Models are cached locally.
162
174
{{< tab name="From the Docker CLI">}}
163
175
164
176
Use the [`docker model pull` command](/reference/cli/docker/model/pull/). For example:
165
-
177
+
166
178
```bash {title="Pulling from Docker Hub"}
167
179
docker model pull ai/smollm2:360M-Q4_K_M
168
180
```
@@ -294,7 +306,7 @@ Once the feature is enabled, new API endpoints are available under the following
294
306
> The `172.17.0.1` interface may not be available by default to containers
295
307
within a Compose project.
296
308
> In this case, add an `extra_hosts` directive to your Compose service YAML:
0 commit comments