You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/manuals/ai/model-runner/_index.md
+17-6Lines changed: 17 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -90,20 +90,25 @@ Models are pulled from Docker Hub the first time they're used and stored locally
90
90
91
91
### Enable DMR in Docker Desktop
92
92
93
-
1. Navigate to the **Beta features** tab in settings.
94
-
2. Tick the **Enable Docker Model Runner** setting.
95
-
3. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
93
+
1. In the settings view, navigate to the **Beta features** tab.
94
+
1. Tick the **Enable Docker Model Runner** setting.
95
+
1. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
96
+
1. Optional: If you want to enable TCP support, select the **Enable host-side TCP support**
97
+
1. In the **Port** field, type the port of your choice.
98
+
1. If you are interacting with Model Runner from a local frontend web app,
99
+
in **CORS Allows Origins**, select the origins that Model Runner should accept requests from.
100
+
An origin is the URL where your web app is running, for example `http://localhost:3131`.
96
101
97
102
You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.
98
103
99
104
> [!IMPORTANT]
100
105
>
101
-
> For Docker Desktop versions 4.41 and earlier, this settings lived under the **Experimental features** tab on the **Features in development** page.
106
+
> For Docker Desktop versions 4.41 and earlier, this setting lived under the **Experimental features** tab on the **Features in development** page.
102
107
103
108
### Enable DMR in Docker Engine
104
109
105
110
1. Ensure you have installed [Docker Engine](/engine/install/).
106
-
2. DMR is available as a package. To install it, run:
111
+
1. DMR is available as a package. To install it, run:
107
112
108
113
{{< tabs >}}
109
114
{{< tab name="Ubuntu/Debian">}}
@@ -124,13 +129,19 @@ You can now use the `docker model` command in the CLI and view and interact with
124
129
{{< /tab >}}
125
130
{{< /tabs >}}
126
131
127
-
3. Test the installation:
132
+
1. Test the installation:
128
133
129
134
```console
130
135
$ docker model version
131
136
$ docker model run ai/smollm2
132
137
```
133
138
139
+
1. Optional: To enable TCP support, set the port with the `DMR_RUNNER_PORT` environment variable.
140
+
1. Optional: If you enabled TCP support, you can configure CORS allowed origins with the `DMR_ORIGINS` environment variable. Possible values are:
Copy file name to clipboardExpand all lines: content/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md
+10-8Lines changed: 10 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -312,14 +312,16 @@ For more information, see [Networking](/manuals/desktop/features/networking.md#n
312
312
>
313
313
> For Docker Desktop versions 4.41 and earlier, some of these settings lived under the **Experimental features** tab on the **Features in development** page.
|`allowBetaFeatures`|| If `value` is set to `true`, beta features are enabled. ||
318
-
|`enableDockerAI`|| If `allowBetaFeatures` is true, setting `enableDockerAI` to `true` enables [Docker AI (Ask Gordon)](/manuals/ai/gordon/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. ||
319
-
|`enableInference`|| If `allowBetaFeatures` is true, setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. ||
320
-
| `enableInferenceTCP`|| Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. ||
321
-
|`enableDockerMCPToolkit`|| If `allowBetaFeatures` is true, setting `enableDockerMCPToolkit` to `true` enables the [MCP toolkit feature](/manuals/ai/mcp-catalog-and-toolkit/toolkit.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. ||
322
-
|`allowExperimentalFeatures`|| If `value` is set to `true`, experimental features are enabled. | Docker Desktop version 4.41 and earlier |
|`allowBetaFeatures`|| If `value` is set to `true`, beta features are enabled. ||
318
+
|`enableDockerAI`|| If `allowBetaFeatures` is true, setting `enableDockerAI` to `true` enables [Docker AI (Ask Gordon)](/manuals/ai/gordon/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. ||
319
+
|`enableInference`|| If `allowBetaFeatures` is true, setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. ||
320
+
| `enableInferenceTCP`|| Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. ||
321
+
| `enableInferenceTCPPort`|| Specifies the exposed TCP port. This setting requires Docker Model Runner setting to be enabled first. ||
322
+
| `enableInferenceCORS`|| Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires Docker Model Runner setting to be enabled first. ||
323
+
|`enableDockerMCPToolkit`|| If `allowBetaFeatures` is true, setting `enableDockerMCPToolkit` to `true` enables the [MCP toolkit feature](/manuals/ai/mcp-catalog-and-toolkit/toolkit.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. ||
324
+
|`allowExperimentalFeatures`|| If `value` is set to `true`, experimental features are enabled. | Docker Desktop version 4.41 and earlier |
Copy file name to clipboardExpand all lines: content/manuals/security/for-admins/hardened-desktop/settings-management/settings-reference.md
+28-3Lines changed: 28 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -795,7 +795,7 @@ third-party or unvetted plugins from being installed.
795
795
-**Beta** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
796
796
- Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
797
797
798
-
### Enable host-side TCP support
798
+
####Enable host-side TCP support
799
799
800
800
| Default value | Accepted values | Format |
801
801
|---------------|-----------------|----------|
@@ -808,11 +808,36 @@ third-party or unvetted plugins from being installed.
808
808
-**Beta** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
809
809
- Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
810
810
811
-
812
811
> [!NOTE]
813
812
>
814
813
> This setting requires Docker Model Runner setting to be enabled first.
815
814
815
+
##### Port
816
+
817
+
| Default value | Accepted values | Format |
818
+
|---------------|-----------------|---------|
819
+
| 12434 | Integer | Integer |
820
+
821
+
-**Description:** Specifies the exposed TCP port.
822
+
-**OS:** {{< badge color=blue text="All" >}}
823
+
-**Use case:** Connect to the Model Runner via TCP.
824
+
-**Configure this setting with:**
825
+
-**Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
826
+
- Settings Management: `enableInferenceTCP` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
| Empty string | Empty string to deny all,`*` to accept all, or a list of comma-separated values | String |
833
+
834
+
-**Description:** Specifies the allowed CORS origins.
835
+
-**OS:** {{< badge color=blue text="All" >}}
836
+
-**Use case:** Integration with a web app.
837
+
-**Configure this setting with:**
838
+
-**Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
839
+
- Settings Management: `enableInferenceCORS` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
840
+
816
841
### Enable Docker MCP Toolkit
817
842
818
843
| Default value | Accepted values | Format |
@@ -1127,4 +1152,4 @@ overrides are possible.
1127
1152
-**OS:** {{< badge color=blue text="All" >}}
1128
1153
-**Use case:** Allow users to authenticate with enterprise proxy servers that require Kerberos or NTLM.
1129
1154
-**Configure this setting with:**
1130
-
- Settings Management: `proxy.enableKerberosNtlm` in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
1155
+
- Settings Management: `proxy.enableKerberosNtlm` in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
0 commit comments