You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/dev-box/how-to-configure-dev-box-serverless-gpu.md
+35-67Lines changed: 35 additions & 67 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,113 +13,81 @@ ai-usage: ai-generated
13
13
14
14
# Use Serverless GPU compute in Microsoft Dev Box
15
15
16
-
Serverless GPU compute in Microsoft Dev Box (preview) lets you spin up dev boxes with GPU acceleration — no additional setup required. Microsoft Dev Box serverless GPU compute enables developers to access powerful GPU resources on demand without requiring permanent infrastructure provisioning or complex setup. This article explains what serverless GPU compute is, how it works, and key scenarios for its use.
16
+
This article explains what serverless GPU compute is, how it works, and key scenarios for its use. Serverless GPU compute in Microsoft Dev Box (preview) lets you spin up dev boxes with GPU acceleration—no extra setup needed. Dev Box serverless GPU compute lets developers use GPU resources on demand without permanent infrastructure or complex setup.
17
17
18
-
## What is serverless GPU compute?
18
+
Common scenarios for serverless GPU compute include compute-intensive workloads like AI model training, inference, and data processing. Serverless GPU compute lets you:
19
19
20
-
Serverless GPU compute in Microsoft Dev Box provides on-demand access to GPU resources for compute-intensive workloads like AI model training, inference, and data processing. Unlike traditional GPU provisioning that requires long-term commitments and upfront investments, serverless GPU compute lets you:
21
-
22
-
- Access GPU resources only when needed
23
-
- Scale GPU resources according to workload demands
24
-
- Pay only for actual GPU usage
25
-
- Work within your organization's secure network environment
20
+
- Use GPU resources only when you need them
21
+
- Scale GPU resources based on workload demands
22
+
- Pay only for the GPU time you use
23
+
- Work in your organization's secure network environment
26
24
27
25
This capability integrates Microsoft Dev Box with Azure Container Apps to deliver GPU power without requiring developers to manage infrastructure.
28
26
29
-
30
-
## Key benefits
31
-
32
-
Serverless GPU compute in Microsoft Dev Box offers distinct benefits for both developers and organizations, making it easier to harness GPU power efficiently and securely.
33
-
34
-
### For developers
35
-
36
-
-**No setup required**: Access GPU compute with a single click from your Dev Box environment
37
-
- Access GPU compute with one step from your Dev Box environment.
38
-
-**No permission barriers**: Use GPU resources without needing rights to create cloud infrastructure.
39
-
-**Integrated development experience**: Seamlessly use GPU compute within familiar tools like Windows Terminal, Visual Studio, and VS Code.
40
-
-**Zero configuration**: GPU sessions start automatically when needed and stop when not in use.
41
-
42
-
### For organizations
43
-
44
-
-**Cost optimization**: Pay only for the GPU resources you use instead of provisioning dedicated hardware.
45
-
-**Centralized control**: Manage GPU access through project-level policies.
46
-
-**Security and compliance**: Keep sensitive data in your secure corporate network while using GPU resources.
47
-
-**Simplified resource management**: Control GPU usage limits at the project level.
48
-
49
-
## How serverless GPU compute works
50
-
51
-
Serverless GPU compute in Dev Box uses Azure Container Apps (ACA) to provide GPU resources on demand. When a developer starts a GPU-enabled shell or tool, Dev Box automatically:
27
+
Serverless GPU compute in Dev Box uses Azure Container Apps (ACA). When a developer starts a GPU-enabled shell or tool, Dev Box automatically:
52
28
53
29
- Creates a connection to a serverless GPU session
54
30
- Provisions the necessary GPU resources
55
31
- Makes those resources available through the developer's terminal or integrated development environment
56
32
- Automatically terminates the session when no longer needed
57
33
58
-
### Available GPU types
59
-
60
-
These GPU options are supported:
61
-
62
-
-**NVIDIA T4 GPUs**: Readily available with minimal quota concerns
63
-
64
-
65
-
### Regional availability
66
-
67
-
GPU resources are available in these Azure regions:
68
-
69
-
- West US 3
70
-
71
-
Additional regions may be supported in the future based on demand.
34
+
## Prerequisites
35
+
- An Azure subscription
36
+
- A Microsoft Dev Box project
72
37
73
38
## Configure Serverless GPU
74
39
75
-
Admins control serverless GPU access at the project level through Dev Center. Key management capabilities include:
40
+
Administrators control serverless GPU access at the project level through Dev Center. Key management capabilities include:
41
+
42
+
-**Enable/disable GPU access**: Control whether projects can use serverless GPU resources.
43
+
-**Set concurrent GPU limits**: Set the maximum number of GPUs that can be used at the same time in a project.
76
44
77
-
-**Enable/disable GPU access**: Control whether projects can use serverless GPU resources
78
-
-**Set concurrent GPU limits**: Specify the maximum number of GPUs that can be used simultaneously across a project
45
+
Access to serverless GPU resources is managed through project-level properties. When the serverless GPU feature is enabled for a project, all Dev Boxes in that project can use GPU compute. This simple access model removes the need for custom roles or pool-based configurations.
79
46
80
-
Access to serverless GPU resources is managed through project-level properties. When the serverless GPU feature is enabled for a project, all Dev Boxes within that project automatically gain access to GPU compute. This simplifies the access model by removing the need for custom roles or pool-based configurations.
47
+
-**NVIDIA T4 GPUs** are supported.
81
48
82
-
### Register for the subscription
49
+
### Register Serverless GPU for the subscription
83
50
84
51
1. Sign in to the [Azure portal](https://portal.azure.com).
85
52
1. Navigate to your subscription.
86
53
1. Select **Settings** > **Preview features**.
87
54
1. Select **Dev Box Serverless GPU Preview**, and then select **Register**.
88
-
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-register-subscription.png" alt-text="Screenshot of the Azure subscription page, showing the Dev Box Serverless GPU Preview feature.":::
55
+
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-register-subscription.png" alt-text="Screenshot of the Azure subscription page, showing the Dev Box Serverless GPU Preview feature." lightbox="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-register-subscription.png":::
89
56
90
57
### Enable serverless GPU for a project
91
58
92
59
1. Go to your project.
93
60
1. Select **Settings** > **Dev box settings**.
94
61
1. Under **AI workloads**, select **Enable**, and then select **Apply**.
95
-
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-project-settings.png" alt-text="Screenshot of the dev box settings page, showing the Serverless GPU option Enabled.":::
62
+
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-project-settings.png" alt-text="Screenshot of the dev box settings page, showing the Serverless GPU option Enabled." lightbox="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-project-settings.png":::
96
63
97
64
## Connect to a GPU
98
-
Once enabled, Dev Box users in that project will automatically see GPU options in their terminal and VS Code environments.
99
65
100
-
You can connect using two methods:
66
+
After you enable serverless GPU, Dev Box users in that project see GPU options in their terminal and VS Code environments.
67
+
68
+
You can connect using one of these methods:
101
69
102
70
### Method 1: Launch a Dev Box GPU shell
103
-
1. Open the Windows Terminal on your dev box
104
-
1. Run the following command:
105
-
```
71
+
72
+
1. Open Windows Terminal on your dev box.
73
+
1. Run the following command:
74
+
```bash
106
75
devbox gpu shell
107
76
```
108
-
1.This command connects you to a pre-configured GPU container.
77
+
1.Connects you to a preconfigured GPU container.
109
78
110
79
### Method 2: Use VS Code with remote tunnels
111
-
1. Open the Windows Terminal on your dev box
112
-
1. Run the following command:
113
-
```
80
+
81
+
1. Open Windows Terminal on your dev box.
82
+
1. Run the following command:
83
+
```bash
114
84
devbox gpu shell
115
85
```
116
-
1. Launch Visual Studio Code
117
-
1. Install the Remote Tunnels extension
86
+
1. Launch Visual Studio Code.
87
+
1. Install the [Remote Tunnels extension](https://code.visualstudio.com/docs/remote/tunnels#_remote-tunnels-extension).
118
88
1. Connect to the **gpu-session** tunnel.
119
-
1.
120
-
For more information on using VS Code with remote tunnels, see [Set up Dev tunnels in VS Code](how-to-set-up-dev-tunnels.md).
121
89
122
90
## Related content
123
91
124
-
-[Blog post](link to be added)
125
-
-[Learn more about Azure Container Apps serverless GPU](/azure/container-apps/sessions-code-interpreter)
92
+
-[Supercharge AI development with new AI-powered features in Microsoft Dev Box](https://aka.ms/devbox/serverlessGPU)
93
+
-[Learn more about Azure Container Apps serverless GPU](/azure/container-apps/sessions-code-interpreter)
0 commit comments