Skip to content

Commit 4da672a

Browse files
author
RoseHJM
committed
DocuMentor edits
1 parent 96e4e22 commit 4da672a

File tree

1 file changed

+35
-67
lines changed

1 file changed

+35
-67
lines changed

articles/dev-box/how-to-configure-dev-box-serverless-gpu.md

Lines changed: 35 additions & 67 deletions
Original file line numberDiff line numberDiff line change
@@ -13,113 +13,81 @@ ai-usage: ai-generated
1313

1414
# Use Serverless GPU compute in Microsoft Dev Box
1515

16-
Serverless GPU compute in Microsoft Dev Box (preview) lets you spin up dev boxes with GPU accelerationno additional setup required. Microsoft Dev Box serverless GPU compute enables developers to access powerful GPU resources on demand without requiring permanent infrastructure provisioning or complex setup. This article explains what serverless GPU compute is, how it works, and key scenarios for its use.
16+
This article explains what serverless GPU compute is, how it works, and key scenarios for its use. Serverless GPU compute in Microsoft Dev Box (preview) lets you spin up dev boxes with GPU accelerationno extra setup needed. Dev Box serverless GPU compute lets developers use GPU resources on demand without permanent infrastructure or complex setup.
1717

18-
## What is serverless GPU compute?
18+
Common scenarios for serverless GPU compute include compute-intensive workloads like AI model training, inference, and data processing. Serverless GPU compute lets you:
1919

20-
Serverless GPU compute in Microsoft Dev Box provides on-demand access to GPU resources for compute-intensive workloads like AI model training, inference, and data processing. Unlike traditional GPU provisioning that requires long-term commitments and upfront investments, serverless GPU compute lets you:
21-
22-
- Access GPU resources only when needed
23-
- Scale GPU resources according to workload demands
24-
- Pay only for actual GPU usage
25-
- Work within your organization's secure network environment
20+
- Use GPU resources only when you need them
21+
- Scale GPU resources based on workload demands
22+
- Pay only for the GPU time you use
23+
- Work in your organization's secure network environment
2624

2725
This capability integrates Microsoft Dev Box with Azure Container Apps to deliver GPU power without requiring developers to manage infrastructure.
2826

29-
30-
## Key benefits
31-
32-
Serverless GPU compute in Microsoft Dev Box offers distinct benefits for both developers and organizations, making it easier to harness GPU power efficiently and securely.
33-
34-
### For developers
35-
36-
- **No setup required**: Access GPU compute with a single click from your Dev Box environment
37-
- Access GPU compute with one step from your Dev Box environment.
38-
- **No permission barriers**: Use GPU resources without needing rights to create cloud infrastructure.
39-
- **Integrated development experience**: Seamlessly use GPU compute within familiar tools like Windows Terminal, Visual Studio, and VS Code.
40-
- **Zero configuration**: GPU sessions start automatically when needed and stop when not in use.
41-
42-
### For organizations
43-
44-
- **Cost optimization**: Pay only for the GPU resources you use instead of provisioning dedicated hardware.
45-
- **Centralized control**: Manage GPU access through project-level policies.
46-
- **Security and compliance**: Keep sensitive data in your secure corporate network while using GPU resources.
47-
- **Simplified resource management**: Control GPU usage limits at the project level.
48-
49-
## How serverless GPU compute works
50-
51-
Serverless GPU compute in Dev Box uses Azure Container Apps (ACA) to provide GPU resources on demand. When a developer starts a GPU-enabled shell or tool, Dev Box automatically:
27+
Serverless GPU compute in Dev Box uses Azure Container Apps (ACA). When a developer starts a GPU-enabled shell or tool, Dev Box automatically:
5228

5329
- Creates a connection to a serverless GPU session
5430
- Provisions the necessary GPU resources
5531
- Makes those resources available through the developer's terminal or integrated development environment
5632
- Automatically terminates the session when no longer needed
5733

58-
### Available GPU types
59-
60-
These GPU options are supported:
61-
62-
- **NVIDIA T4 GPUs**: Readily available with minimal quota concerns
63-
64-
65-
### Regional availability
66-
67-
GPU resources are available in these Azure regions:
68-
69-
- West US 3
70-
71-
Additional regions may be supported in the future based on demand.
34+
## Prerequisites
35+
- An Azure subscription
36+
- A Microsoft Dev Box project
7237

7338
## Configure Serverless GPU
7439

75-
Admins control serverless GPU access at the project level through Dev Center. Key management capabilities include:
40+
Administrators control serverless GPU access at the project level through Dev Center. Key management capabilities include:
41+
42+
- **Enable/disable GPU access**: Control whether projects can use serverless GPU resources.
43+
- **Set concurrent GPU limits**: Set the maximum number of GPUs that can be used at the same time in a project.
7644

77-
- **Enable/disable GPU access**: Control whether projects can use serverless GPU resources
78-
- **Set concurrent GPU limits**: Specify the maximum number of GPUs that can be used simultaneously across a project
45+
Access to serverless GPU resources is managed through project-level properties. When the serverless GPU feature is enabled for a project, all Dev Boxes in that project can use GPU compute. This simple access model removes the need for custom roles or pool-based configurations.
7946

80-
Access to serverless GPU resources is managed through project-level properties. When the serverless GPU feature is enabled for a project, all Dev Boxes within that project automatically gain access to GPU compute. This simplifies the access model by removing the need for custom roles or pool-based configurations.
47+
- **NVIDIA T4 GPUs** are supported.
8148

82-
### Register for the subscription
49+
### Register Serverless GPU for the subscription
8350

8451
1. Sign in to the [Azure portal](https://portal.azure.com).
8552
1. Navigate to your subscription.
8653
1. Select **Settings** > **Preview features**.
8754
1. Select **Dev Box Serverless GPU Preview**, and then select **Register**.
88-
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-register-subscription.png" alt-text="Screenshot of the Azure subscription page, showing the Dev Box Serverless GPU Preview feature. ":::
55+
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-register-subscription.png" alt-text="Screenshot of the Azure subscription page, showing the Dev Box Serverless GPU Preview feature." lightbox="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-register-subscription.png":::
8956

9057
### Enable serverless GPU for a project
9158

9259
1. Go to your project.
9360
1. Select **Settings** > **Dev box settings**.
9461
1. Under **AI workloads**, select **Enable**, and then select **Apply**.
95-
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-project-settings.png" alt-text="Screenshot of the dev box settings page, showing the Serverless GPU option Enabled.":::
62+
:::image type="content" source="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-project-settings.png" alt-text="Screenshot of the dev box settings page, showing the Serverless GPU option Enabled." lightbox="media/how-to-configure-dev-box-serverless-gpu/serverless-gpu-project-settings.png":::
9663

9764
## Connect to a GPU
98-
Once enabled, Dev Box users in that project will automatically see GPU options in their terminal and VS Code environments.
9965

100-
You can connect using two methods:
66+
After you enable serverless GPU, Dev Box users in that project see GPU options in their terminal and VS Code environments.
67+
68+
You can connect using one of these methods:
10169

10270
### Method 1: Launch a Dev Box GPU shell
103-
1. Open the Windows Terminal on your dev box
104-
1. Run the following command:
105-
```
71+
72+
1. Open Windows Terminal on your dev box.
73+
1. Run the following command:
74+
```bash
10675
devbox gpu shell
10776
```
108-
1. This command connects you to a pre-configured GPU container.
77+
1. Connects you to a preconfigured GPU container.
10978

11079
### Method 2: Use VS Code with remote tunnels
111-
1. Open the Windows Terminal on your dev box
112-
1. Run the following command:
113-
```
80+
81+
1. Open Windows Terminal on your dev box.
82+
1. Run the following command:
83+
```bash
11484
devbox gpu shell
11585
```
116-
1. Launch Visual Studio Code
117-
1. Install the Remote Tunnels extension
86+
1. Launch Visual Studio Code.
87+
1. Install the [Remote Tunnels extension](https://code.visualstudio.com/docs/remote/tunnels#_remote-tunnels-extension).
11888
1. Connect to the **gpu-session** tunnel.
119-
1.
120-
For more information on using VS Code with remote tunnels, see [Set up Dev tunnels in VS Code](how-to-set-up-dev-tunnels.md).
12189

12290
## Related content
12391

124-
- [Blog post](link to be added)
125-
- [Learn more about Azure Container Apps serverless GPU](/azure/container-apps/sessions-code-interpreter)
92+
- [Supercharge AI development with new AI-powered features in Microsoft Dev Box](https://aka.ms/devbox/serverlessGPU)
93+
- [Learn more about Azure Container Apps serverless GPU](/azure/container-apps/sessions-code-interpreter)

0 commit comments

Comments
 (0)