Skip to content

Commit 861a4f7

Browse files
doringemanaevesdockerxenoscopic
authored
settings-management: Docker Model Runner GA (#23383)
<!--Delete sections as needed --> ## Description <!-- Tell us what you did and why --> - Added `enableInferenceGPUVariant` to the AI settings table. - Added the Docker Model Runner settings in the `admin-settings.json` file example. - Mentioned the AI settings group in Docker Desktop in the settings reference. - Added `enableInferenceGPUVariant` in the settings reference. - Mentioned the Admin Console for the Docker Model Runner settings in the settings reference. ## Related issues or tickets https://docs.docker.com/ai/model-runner/ https://docker.slack.com/archives/C02DDPKLJ0J/p1757437016971229?thread_ts=1757416342.491719&cid=C02DDPKLJ0J ## Reviews <!-- Notes for reviewers here --> <!-- List applicable reviews (optionally @tag reviewers) --> - [ ] Technical review - [ ] Editorial review - [ ] Product review --------- Signed-off-by: Dorin Geman <[email protected]> Co-authored-by: Allie Sadler <[email protected]> Co-authored-by: Jacob Howard <[email protected]>
1 parent 8158dfb commit 861a4f7

File tree

2 files changed

+58
-9
lines changed

2 files changed

+58
-9
lines changed

‎content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md‎

Lines changed: 27 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -216,6 +216,26 @@ The following sample is an `admin-settings.json` file with common enterprise set
216216
"desktopTerminalEnabled": {
217217
"locked": false,
218218
"value": false
219+
},
220+
"enableInference": {
221+
"locked": false,
222+
"value": true
223+
},
224+
"enableInferenceTCP": {
225+
"locked": false,
226+
"value": true
227+
},
228+
"enableInferenceTCPPort": {
229+
"locked": true,
230+
"value": 12434
231+
},
232+
"enableInferenceCORS": {
233+
"locked": true,
234+
"value": ""
235+
},
236+
"enableInferenceGPUVariant": {
237+
"locked": true,
238+
"value": true
219239
}
220240
}
221241
```
@@ -334,12 +354,13 @@ For more information, see [Networking](/manuals/desktop/features/networking.md#n
334354

335355
### AI settings
336356

337-
| Parameter | OS | Description | Version |
338-
|:-----------------------------------------------------|----|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------|
339-
| `enableInference` | | If `allowBetaFeatures` is true, setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
340-
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceTCP` | | Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. | |
341-
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires Docker Model Runner setting to be enabled first. | |
342-
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires Docker Model Runner setting to be enabled first. | |
357+
| Parameter | OS | Description | Version |
358+
|:----------------------------|---------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------|
359+
| `enableInference` | | Setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md). | |
360+
| `enableInferenceTCP` | | Enable host-side TCP support. This setting requires the Docker Model Runner setting to be enabled first. | |
361+
| `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires the Docker Model Runner and Enable host-side TCP support settings to be enabled first. | |
362+
| `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires the Docker Model Runner and Enable host-side TCP support settings to be enabled first. | |
363+
| `enableInferenceGPUVariant` | Windows only | Setting `enableInferenceGPUVariant` to `true` enables GPU-backed inference. The additional components required for this don't come by default with Docker Desktop, therefore they will be downloaded to `~/.docker/bin/inference`. | |
343364

344365
### Beta features
345366

‎content/manuals/enterprise/security/hardened-desktop/settings-management/settings-reference.md‎

Lines changed: 31 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -616,13 +616,15 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu
616616

617617
| Default value | Accepted values | Format |
618618
|---------------|-----------------|----------|
619-
| `true` | `true`, `false` | Boolean |
619+
| `true` | `true`, `false` | Boolean |
620620

621621
- **Description:** Docker Model Runner functionality for running AI models in containers.
622622
- **OS:** {{< badge color=blue text="All" >}}
623623
- **Use case:** Run and manage AI/ML models using Docker infrastructure.
624624
- **Configure this setting with:**
625+
- **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
625626
- Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md)
627+
- Settings Management: **Enable Docker Model Runner** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md)
626628

627629
#### Enable host-side TCP support
628630

@@ -634,7 +636,9 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu
634636
- **OS:** {{< badge color=blue text="All" >}}
635637
- **Use case:** Allow external applications to connect to Model Runner via TCP.
636638
- **Configure this setting with:**
639+
- **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
637640
- Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md)
641+
- Settings Management: **Host-side TCP support** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md)
638642

639643
> [!NOTE]
640644
>
@@ -650,8 +654,13 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu
650654
- **OS:** {{< badge color=blue text="All" >}}
651655
- **Use case:** Customize the port for Model Runner TCP connectivity.
652656
- **Configure this setting with:**
653-
- **Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
657+
- **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
654658
- Settings Management: `enableInferenceTCP` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md)
659+
- Settings Management: **Host-side TCP port** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md)
660+
661+
> [!NOTE]
662+
>
663+
> This setting requires Docker Model Runner and host-side TCP support settings to be enabled first.
655664
656665
##### CORS Allowed Origins
657666

@@ -663,8 +672,27 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu
663672
- **OS:** {{< badge color=blue text="All" >}}
664673
- **Use case:** Allow web applications to connect to Model Runner services.
665674
- **Configure this setting with:**
666-
- **Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
675+
- **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
667676
- Settings Management: `enableInferenceCORS` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md)
677+
- Settings Management: **CORS Allowed Origins** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md)
678+
679+
> [!NOTE]
680+
>
681+
> This setting requires Docker Model Runner and host-side TCP support settings to be enabled first.
682+
683+
#### Enable GPU-backed inference
684+
685+
| Default value | Accepted values | Format |
686+
|---------------|-----------------|----------|
687+
| `false` | `true`, `false` | Boolean |
688+
689+
- **Description:** GPU-backed inference.
690+
- **OS:** {{< badge color=blue text="Windows only" >}}
691+
- **Use case:** Enable GPU-backed inference. Additional components will be downloaded to ~/.docker/bin/inference.
692+
- **Configure this setting with:**
693+
- **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
694+
- Settings Management: `enableInferenceGPUVariant` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md)
695+
- Settings Management: **Enable GPU-backed inference** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md)
668696

669697
## Kubernetes settings
670698

0 commit comments

Comments
 (0)