@@ -30,23 +30,23 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
3030> For Docker Desktop versions 4.41 and earlier, this setting was under the
3131> ** Experimental features** tab on the ** Features in development** page.
3232
33- ### Enable Docker Model Runner in Docker Engine
33+ ### Enable DMR in Docker Engine
3434
35351 . Ensure you have installed [ Docker Engine] ( /engine/install/ ) .
36361 . Docker Model Runner is available as a package. To install it, run:
3737
3838 {{< tabs >}}
3939 {{< tab name="Ubuntu/Debian">}}
4040
41- ``` console
41+ ``` bash
4242 $ sudo apt-get update
4343 $ sudo apt-get install docker-model-plugin
4444 ```
4545
4646 {{< /tab >}}
4747 {{< tab name="RPM-base distributions">}}
4848
49- ``` console
49+ ``` bash
5050 $ sudo dnf update
5151 $ sudo dnf install docker-model-plugin
5252 ```
@@ -56,21 +56,21 @@ with your local models in the **Models** tab in the Docker Desktop Dashboard.
5656
57571 . Test the installation:
5858
59- ``` console
59+ ``` bash
6060 $ docker model version
6161 $ docker model run ai/smollm2
6262 ```
6363
6464> [ !NOTE]
6565> TCP support is enabled by default for Docker Engine on port ` 12434 ` .
6666
67- ### Update Docker Model Runner in Docker Engine
67+ ### Update DMR in Docker Engine
6868
6969To update Docker Model Runner in Docker Engine, uninstall it with
7070[ ` docker model uninstall-runner ` ] ( /reference/cli/docker/model/uninstall-runner/ )
7171then reinstall it:
7272
73- ``` console
73+ ``` bash
7474docker model uninstall-runner --images && docker model install-runner
7575```
7676
@@ -133,8 +133,9 @@ Use the [`docker model run` command](/reference/cli/docker/model/run/).
133133
134134## Configure a model
135135
136- You can configure a model, such as the its maximum token limit and more,
137- use Docker Compose. See [ Models and Compose - Model configuration options] ( ../compose/models-and-compose.md#model-configuration-options ) .
136+ You can configure a model, such as its maximum token limit and more,
137+ use Docker Compose.
138+ See [ Models and Compose - Model configuration options] ( ../compose/models-and-compose.md#model-configuration-options ) .
138139
139140## Publish a model
140141
@@ -146,7 +147,7 @@ use Docker Compose. See [Models and Compose - Model configuration options](../co
146147You can tag existing models with a new name and publish them under a different
147148namespace and repository:
148149
149- ``` console
150+ ``` bash
150151# Tag a pulled model under a new name
151152$ docker model tag ai/smollm2 myorg/smollm2
152153
@@ -161,7 +162,7 @@ documentation.
161162You can also package a model file in GGUF format as an OCI Artifact and publish
162163it to Docker Hub.
163164
164- ``` console
165+ ``` bash
165166# Download a model file in GGUF format, for example from HuggingFace
166167$ curl -L -o model.gguf https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF/resolve/main/mistral-7b-v0.1.Q4_K_M.gguf
167168
@@ -209,7 +210,7 @@ In Docker Desktop, to inspect the requests and responses for each model:
209210 - The prompt/request
210211 - The context usage
211212 - The time it took for the response to be generated.
212- 2 . Select one of the requests to display further details:
213+ 1 . Select one of the requests to display further details:
213214 - In the ** Overview** tab, view the token usage, response metadata and generation speed, and the actual prompt and response.
214215 - In the ** Request** and ** Response** tabs, view the full JSON payload of the request and the response.
215216
@@ -220,4 +221,4 @@ In Docker Desktop, to inspect the requests and responses for each model:
220221
221222- [ Interact with your model programmatically] ( ./api-reference.md )
222223- [ Models and Compose] ( ../compose/models-and-compose.md )
223- - [ Docker Model Runner cli reference documentation] ( /reference/cli/docker/model )
224+ - [ Docker Model Runner CLI reference documentation] ( /reference/cli/docker/model )
0 commit comments