You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/manuals/ai/model-runner/_index.md
+17-6Lines changed: 17 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -39,20 +39,25 @@ Models are pulled from Docker Hub the first time they're used and stored locally
39
39
40
40
### Enable DMR in Docker Desktop
41
41
42
-
1. Navigate to the **Beta features** tab in settings.
43
-
2. Tick the **Enable Docker Model Runner** setting.
44
-
3. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
42
+
1. In the settings view, navigate to the **Beta features** tab.
43
+
1. Tick the **Enable Docker Model Runner** setting.
44
+
1. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
45
+
1. Optional: If you want to enable TCP support, select the **Enable host-side TCP support**
46
+
1. In the **Port** field, type the port of your choice.
47
+
1. If you are interacting with Model Runner from a local frontend web app,
48
+
in **CORS Allows Origins**, select the origins that Model Runner should accept requests from.
49
+
An origin is the URL where your web app is running, for example `http://localhost:3131`.
45
50
46
51
You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.
47
52
48
53
> [!IMPORTANT]
49
54
>
50
-
> For Docker Desktop versions 4.41 and earlier, this settings lived under the **Experimental features** tab on the **Features in development** page.
55
+
> For Docker Desktop versions 4.41 and earlier, this setting lived under the **Experimental features** tab on the **Features in development** page.
51
56
52
57
### Enable DMR in Docker Engine
53
58
54
59
1. Ensure you have installed [Docker Engine](/engine/install/).
55
-
2. DMR is available as a package. To install it, run:
60
+
1. DMR is available as a package. To install it, run:
56
61
57
62
{{< tabs >}}
58
63
{{< tab name="Ubuntu/Debian">}}
@@ -73,13 +78,19 @@ You can now use the `docker model` command in the CLI and view and interact with
73
78
{{< /tab >}}
74
79
{{< /tabs >}}
75
80
76
-
3. Test the installation:
81
+
1. Test the installation:
77
82
78
83
```console
79
84
$ docker model version
80
85
$ docker model run ai/smollm2
81
86
```
82
87
88
+
1. Optional: To enable TCP support, set the port with the `DMR_RUNNER_PORT` environment variable.
89
+
1. Optional: If you enabled TCP support, you can configure CORS allowed origins with the `DMR_ORIGINS` environment variable. Possible values are:
0 commit comments