Skip to content

Commit 3eaccf8

Browse files
committed
dmr: plugin install
1 parent 50bd730 commit 3eaccf8

File tree

3 files changed

+41
-5
lines changed

3 files changed

+41
-5
lines changed

content/manuals/ai/model-runner.md

Lines changed: 36 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ params:
88
group: AI
99
weight: 20
1010
description: Learn how to use Docker Model Runner to manage and run AI models.
11-
keywords: Docker, ai, model runner, docker deskotp, llm
11+
keywords: Docker, ai, model runner, docker desktop, docker engine, llm
1212
aliases:
1313
- /desktop/features/model-runner/
1414
- /ai/model-runner/
@@ -32,6 +32,8 @@ Models are pulled from Docker Hub the first time they're used and stored locally
3232
3333
## Enable Docker Model Runner
3434

35+
### Enable DMR in Docker Desktop
36+
3537
1. Navigate to the **Features in development** tab in settings.
3638
2. Under the **Experimental features** tab, select **Access experimental features**.
3739
3. Select **Apply and restart**.
@@ -42,6 +44,36 @@ Models are pulled from Docker Hub the first time they're used and stored locally
4244

4345
You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.
4446

47+
### Enable DMR in Docker Engine
48+
49+
1. Ensure you have installed [Docker Engine](/engine/install/).
50+
2. DMR is available as a package. To install it, run:
51+
52+
{{< tabs >}}
53+
{{< tab name="Ubuntu/Debian">}}
54+
55+
```console
56+
$ sudo apt-get update
57+
$ sudo apt-get install docker-model-runner
58+
```
59+
60+
{{< /tab >}}
61+
{{< tab name="RPM-base distributions">}}
62+
63+
```console
64+
$ sudo yum update
65+
$ sudo yum install docker-model-runner
66+
```
67+
68+
{{< /tab >}}
69+
{{< /tabs >}}
70+
71+
3. Test the installation:
72+
73+
```console
74+
$ docker model status
75+
```
76+
4577
## Available commands
4678

4779
### Model runner status
@@ -233,7 +265,7 @@ If you want to try an existing GenAI application, follow these instructions.
233265

234266
4. Open you app in the browser at the addresses specified in the repository [README](https://github.com/docker/hello-genai).
235267

236-
You'll see the GenAI app's interface where you can start typing your prompts.
268+
You'll see the GenAI app's interface where you can start typing your prompts.
237269

238270
You can now interact with your own GenAI app, powered by a local model. Try a few prompts and notice how fast the responses are — all running on your machine with Docker.
239271

@@ -378,15 +410,15 @@ Once linked, re-run the command.
378410

379411
### No safeguard for running oversized models
380412

381-
Currently, Docker Model Runner doesn't include safeguards to prevent you from launching models that exceed their system's available resources. Attempting to run a model that is too large for the host machine may result in severe slowdowns or render the system temporarily unusable. This issue is particularly common when running LLMs models without sufficient GPU memory or system RAM.
413+
Currently, Docker Model Runner doesn't include safeguards to prevent you from launching models that exceed their systems available resources. Attempting to run a model that is too large for the host machine may result in severe slowdowns or render the system temporarily unusable. This issue is particularly common when running LLMs models without sufficient GPU memory or system RAM.
382414

383415
### No consistent digest support in Model CLI
384416

385417
The Docker Model CLI currently lacks consistent support for specifying models by image digest. As a temporary workaround, you should refer to models by name instead of digest.
386418

387419
## Share feedback
388420

389-
Thanks for trying out Docker Model Runner. Give feedback or report any bugs you may find through the **Give feedback** link next to the **Enable Docker Model Runner** setting.
421+
Thanks for trying out Docker Model Runner. Give feedback or report any bugs you may find through the **Give feedback** link next to the **Enable Docker Model Runner** setting.
390422

391423
## Disable the feature
392424

data/summary.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -148,7 +148,7 @@ Docker GitHub Copilot:
148148
availability: Early Access
149149
Docker Model Runner:
150150
availability: Beta
151-
requires: Docker Desktop 4.40 and later
151+
requires: Docker Engine, or Docker Desktop 4.40 and later
152152
for: Docker Desktop for Mac with Apple Silicon or Windows with NVIDIA GPUs
153153
Docker Projects:
154154
availability: Beta

hugo_stats.json

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -80,6 +80,7 @@
8080
"Mac-with-Apple-silicon",
8181
"Mac-with-Intel-chip",
8282
"Manually-create-assets",
83+
"Manually-set-it-up",
8384
"NetworkManager",
8485
"Node",
8586
"Non-compliant",
@@ -94,6 +95,7 @@
9495
"RHEL-8",
9596
"RHEL-9",
9697
"RHEL-CentOS-or-Fedora",
98+
"RPM-base-distributions",
9799
"Raw",
98100
"React",
99101
"Regular-install",
@@ -107,12 +109,14 @@
107109
"Specific-version",
108110
"Svelte",
109111
"Ubuntu",
112+
"Ubuntu/Debian",
110113
"Unix-pipe",
111114
"Updated-Dockerfile",
112115
"Use-Docker-Init",
113116
"Use-OpenAI",
114117
"Using-the-CLI",
115118
"Using-the-GUI",
119+
"Using-the-MCP-Toolkit-Recommended",
116120
"VS-Code",
117121
"Vue",
118122
"WSL-2-backend-x86_64",

0 commit comments

Comments
 (0)