Skip to content

Commit 8540380

Browse files
authored
dmr: touch ups (#23239)
Minor touch ups in DMR section.
1 parent 2fd23a4 commit 8540380

File tree

5 files changed

+21
-17
lines changed

5 files changed

+21
-17
lines changed

assets/icons/models.svg

Lines changed: 3 additions & 0 deletions
Loading

content/manuals/_index.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -36,15 +36,15 @@ params:
3636
description: Manage and secure your AI tools with a single gateway.
3737
icon: /icons/toolkit.svg
3838
link: /ai/mcp-gateway/
39-
39+
4040
ai:
4141
- title: Ask Gordon
4242
description: Streamline your workflow and get the most out of the Docker ecosystem with your personal AI assistant.
4343
icon: note_add
4444
link: /ai/gordon/
4545
- title: Docker Model Runner
4646
description: View and manage your local models.
47-
icon: view_in_ar
47+
icon: /icons/models.svg
4848
link: /ai/model-runner/
4949
- title: MCP Catalog and Toolkit
5050
description: Augment your AI workflow with MCP servers.
@@ -126,7 +126,7 @@ Open source development and containerization technologies.
126126

127127
## AI
128128

129-
All the Docker AI tools in one easy-to-access location.
129+
All the Docker AI tools in one easy-to-access location.
130130

131131
{{< grid items=ai >}}
132132

@@ -145,6 +145,6 @@ subscription management.
145145

146146
## Enterprise
147147

148-
Targeted at IT administrators with help on deploying Docker Desktop at scale with configuration guidance on security related features.
148+
Targeted at IT administrators with help on deploying Docker Desktop at scale with configuration guidance on security related features.
149149

150150
{{< grid items=enterprise >}}

content/manuals/ai/model-runner/api-reference.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -144,7 +144,7 @@ To call the `chat/completions` OpenAI endpoint from the host via TCP:
144144
If you are running on Windows, also enable GPU-backed inference.
145145
See [Enable Docker Model Runner](get-started.md#enable-docker-model-runner-in-docker-desktop).
146146
147-
2. Interact with it as documented in the previous section using `localhost` and the correct port.
147+
1. Interact with it as documented in the previous section using `localhost` and the correct port.
148148
149149
```bash
150150
#!/bin/sh

content/manuals/ai/model-runner/get-started.md

Lines changed: 13 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -30,23 +30,23 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
3030
> For Docker Desktop versions 4.41 and earlier, this setting was under the
3131
> **Experimental features** tab on the **Features in development** page.
3232
33-
### Enable Docker Model Runner in Docker Engine
33+
### Enable DMR in Docker Engine
3434

3535
1. Ensure you have installed [Docker Engine](/engine/install/).
3636
1. Docker Model Runner is available as a package. To install it, run:
3737

3838
{{< tabs >}}
3939
{{< tab name="Ubuntu/Debian">}}
4040

41-
```console
41+
```bash
4242
$ sudo apt-get update
4343
$ sudo apt-get install docker-model-plugin
4444
```
4545

4646
{{< /tab >}}
4747
{{< tab name="RPM-base distributions">}}
4848

49-
```console
49+
```bash
5050
$ sudo dnf update
5151
$ sudo dnf install docker-model-plugin
5252
```
@@ -56,21 +56,21 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
5656

5757
1. Test the installation:
5858

59-
```console
59+
```bash
6060
$ docker model version
6161
$ docker model run ai/smollm2
6262
```
6363

6464
> [!NOTE]
6565
> TCP support is enabled by default for Docker Engine on port `12434`.
6666
67-
### Update Docker Model Runner in Docker Engine
67+
### Update DMR in Docker Engine
6868

6969
To update Docker Model Runner in Docker Engine, uninstall it with
7070
[`docker model uninstall-runner`](/reference/cli/docker/model/uninstall-runner/)
7171
then reinstall it:
7272

73-
```console
73+
```bash
7474
docker model uninstall-runner --images && docker model install-runner
7575
```
7676

@@ -133,8 +133,9 @@ Use the [`docker model run` command](/reference/cli/docker/model/run/).
133133

134134
## Configure a model
135135

136-
You can configure a model, such as the its maximum token limit and more,
137-
use Docker Compose. See [Models and Compose - Model configuration options](../compose/models-and-compose.md#model-configuration-options).
136+
You can configure a model, such as its maximum token limit and more,
137+
use Docker Compose.
138+
See [Models and Compose - Model configuration options](../compose/models-and-compose.md#model-configuration-options).
138139

139140
## Publish a model
140141

@@ -146,7 +147,7 @@ use Docker Compose. See [Models and Compose - Model configuration options](../co
146147
You can tag existing models with a new name and publish them under a different
147148
namespace and repository:
148149

149-
```console
150+
```bash
150151
# Tag a pulled model under a new name
151152
$ docker model tag ai/smollm2 myorg/smollm2
152153

@@ -161,7 +162,7 @@ documentation.
161162
You can also package a model file in GGUF format as an OCI Artifact and publish
162163
it to Docker Hub.
163164

164-
```console
165+
```bash
165166
# Download a model file in GGUF format, for example from HuggingFace
166167
$ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf
167168

@@ -209,7 +210,7 @@ In Docker Desktop, to inspect the requests and responses for each model:
209210
- The prompt/request
210211
- The context usage
211212
- The time it took for the response to be generated.
212-
2. Select one of the requests to display further details:
213+
1. Select one of the requests to display further details:
213214
- In the **Overview** tab, view the token usage, response metadata and generation speed, and the actual prompt and response.
214215
- In the **Request** and **Response** tabs, view the full JSON payload of the request and the response.
215216

@@ -220,4 +221,4 @@ In Docker Desktop, to inspect the requests and responses for each model:
220221

221222
- [Interact with your model programmatically](./api-reference.md)
222223
- [Models and Compose](../compose/models-and-compose.md)
223-
- [Docker Model Runner cli reference documentation](/reference/cli/docker/model)
224+
- [Docker Model Runner CLI reference documentation](/reference/cli/docker/model)

content/manuals/ai/model-runner/setup.md

Whitespace-only changes.

0 commit comments

Comments
 (0)