You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-compute-instance.md
+8-13Lines changed: 8 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,27 +24,22 @@ Use a compute instance as your fully configured and managed development environm
24
24
25
25
For compute instance Jupyter functionality to work, ensure that web socket communication isn't disabled. Ensure your network allows websocket connections to *.instances.azureml.net and *.instances.azureml.ms.
26
26
27
-
> [!IMPORTANT]
28
-
> Items marked (preview) in this article are currently in public preview.
29
-
> The preview version is provided without a service level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
30
-
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
31
-
32
27
## Why use a compute instance?
33
28
34
29
A compute instance is a fully managed cloud-based workstation optimized for your machine learning development environment. It provides the following benefits:
35
30
36
31
|Key benefits|Description|
37
32
|----|----|
38
-
|Productivity|You can build and deploy models using integrated notebooks and the following tools in Azure Machine Learning studio:<br/>- Jupyter<br/>- JupyterLab<br/>- VS Code (preview)<br/>Compute instance is fully integrated with Azure Machine Learning workspace and studio. You can share notebooks and data with other data scientists in the workspace.<br/>
33
+
|Productivity|You can build and deploy models using integrated notebooks and the following tools in Azure Machine Learning studio:<br/>- Jupyter<br/>- JupyterLab<br/>- VS Code<br/>Compute instance is fully integrated with Azure Machine Learning workspace and studio. You can share notebooks and data with other data scientists in the workspace.<br/>
39
34
|Managed & secure|Reduce your security footprint and add compliance with enterprise security requirements. Compute instances provide robust management policies and secure networking configurations such as:<br/><br/>- Autoprovisioning from Resource Manager templates or Azure Machine Learning SDK<br/>- [Azure role-based access control (Azure RBAC)](../role-based-access-control/overview.md)<br/>- [Virtual network support](./how-to-secure-training-vnet.md)<br/> - Azure policy to disable SSH access<br/> - Azure policy to enforce creation in a virtual network <br/> - Auto-shutdown/auto-start based on schedule <br/>- TLS 1.2 enabled |
40
35
|Preconfigured for ML|Save time on setup tasks with pre-configured and up-to-date ML packages, deep learning frameworks, GPU drivers.|
41
36
|Fully customizable|Broad support for Azure VM types including GPUs and persisted low-level customization such as installing packages and drivers makes advanced scenarios a breeze. You can also use setup scripts to automate customization |
42
37
43
38
* Secure your compute instance with **[No public IP](./how-to-secure-training-vnet.md)**.
44
39
* The compute instance is also a secure training compute target similar to [compute clusters](how-to-create-attach-compute-cluster.md), but it's single node.
45
-
* You can [create a compute instance](how-to-create-manage-compute-instance.md?tabs=python#create) yourself, or an administrator can **[create a compute instance on your behalf](how-to-create-manage-compute-instance.md?tabs=python#create-on-behalf-of-preview)**.
40
+
* You can [create a compute instance](how-to-create-manage-compute-instance.md?tabs=python#create) yourself, or an administrator can **[create a compute instance on your behalf](how-to-create-manage-compute-instance.md?tabs=python#create-on-behalf-of)**.
46
41
* You can also **[use a setup script](how-to-customize-compute-instance.md)** for an automated way to customize and configure the compute instance as per your needs.
47
-
* To save on costs, **[create a schedule](how-to-create-manage-compute-instance.md#schedule-automatic-start-and-stop)** to automatically start and stop the compute instance, or [enable idle shutdown](how-to-create-manage-compute-instance.md#enable-idle-shutdown-preview)
42
+
* To save on costs, **[create a schedule](how-to-create-manage-compute-instance.md#schedule-automatic-start-and-stop)** to automatically start and stop the compute instance, or [enable idle shutdown](how-to-create-manage-compute-instance.md#enable-idle-shutdown)
48
43
49
44
50
45
## Tools and environments
@@ -72,7 +67,7 @@ Following tools and environments are already installed on the compute instance:
72
67
|----|:----:|
73
68
|R kernel||
74
69
75
-
You can [Add RStudio or Posit Workbench (formerly RStudio Workbench)](how-to-create-manage-compute-instance.md#add-custom-applications-such-as-rstudio-or-posit-workbench-preview) when you create the instance.
70
+
You can [Add RStudio or Posit Workbench (formerly RStudio Workbench)](how-to-create-manage-compute-instance.md#add-custom-applications-such-as-rstudio-or-posit-workbench) when you create the instance.
76
71
77
72
|**PYTHON** tools & environments|Details|
78
73
|----|----|
@@ -108,9 +103,9 @@ Follow the steps in the [Quickstart: Create workspace resources you need to get
108
103
109
104
For more options, see [create a new compute instance](how-to-create-manage-compute-instance.md?tabs=azure-studio#create).
110
105
111
-
As an administrator, you can **[create a compute instance for others in the workspace (preview)](how-to-create-manage-compute-instance.md#create-on-behalf-of-preview)**.
106
+
As an administrator, you can **[create a compute instance for others in the workspace](how-to-create-manage-compute-instance.md#create-on-behalf-of)**.
112
107
113
-
You can also **[use a setup script (preview)](how-to-customize-compute-instance.md)** for an automated way to customize and configure the compute instance.
108
+
You can also **[use a setup script](how-to-customize-compute-instance.md)** for an automated way to customize and configure the compute instance.
114
109
115
110
Other ways to create a compute instance:
116
111
* Directly from the integrated notebooks experience.
@@ -131,13 +126,13 @@ A compute instance:
131
126
132
127
* Has a job queue.
133
128
* Runs jobs securely in a virtual network environment, without requiring enterprises to open up SSH port. The job executes in a containerized environment and packages your model dependencies in a Docker container.
134
-
* Can run multiple small jobs in parallel (preview). One job per core can run in parallel while the rest of the jobs are queued.
129
+
* Can run multiple small jobs in parallel. One job per core can run in parallel while the rest of the jobs are queued.
135
130
* Supports single-node multi-GPU [distributed training](how-to-train-distributed-gpu.md) jobs
136
131
137
132
You can use compute instance as a local inferencing deployment target for test/debug scenarios.
138
133
139
134
> [!TIP]
140
-
> The compute instance has 120GB OS disk. If you run out of disk space and get into an unusable state, please clear at least 5 GB disk space on OS disk (mounted on /) through the compute instance terminal by removing files/folders and then do `sudo reboot`. Temporary disk will be freed after restart; you do not need to clear space on temp disk manually. To access the terminal go to compute list page or compute instance details page and click on **Terminal** link. You can check available disk space by running `df -h` on the terminal. Clear at least 5 GB space before doing `sudo reboot`. Please do not stop or restart the compute instance through the Studio until 5 GB disk space has been cleared. Auto shutdowns, including scheduled start or stop as well as idle shutdowns(preview), will not work if the CI disk is full.
135
+
> The compute instance has 120GB OS disk. If you run out of disk space and get into an unusable state, please clear at least 5 GB disk space on OS disk (mounted on /) through the compute instance terminal by removing files/folders and then do `sudo reboot`. Temporary disk will be freed after restart; you do not need to clear space on temp disk manually. To access the terminal go to compute list page or compute instance details page and click on **Terminal** link. You can check available disk space by running `df -h` on the terminal. Clear at least 5 GB space before doing `sudo reboot`. Please do not stop or restart the compute instance through the Studio until 5 GB disk space has been cleared. Auto shutdowns, including scheduled start or stop as well as idle shutdowns, will not work if the CI disk is full.
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-create-manage-compute-instance.md
+12-40Lines changed: 12 additions & 40 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -25,17 +25,12 @@ Learn how to create and manage a [compute instance](concept-compute-instance.md)
25
25
26
26
Use a compute instance as your fully configured and managed development environment in the cloud. For development and testing, you can also use the instance as a [training compute target](concept-compute-target.md#training-compute-targets). A compute instance can run multiple jobs in parallel and has a job queue. As a development environment, a compute instance can't be shared with other users in your workspace.
27
27
28
-
> [!IMPORTANT]
29
-
> Items marked (preview) in this article are currently in public preview.
30
-
> The preview version is provided without a service level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
31
-
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
32
-
33
28
In this article, you learn how to:
34
29
35
30
*[Create](#create) a compute instance
36
31
*[Manage](#manage) (start, stop, restart, delete) a compute instance
37
32
*[Create a schedule](#schedule-automatic-start-and-stop) to automatically start and stop the compute instance
You can also [use a setup script](how-to-customize-compute-instance.md) to create the compute instance with your own custom environment.
41
36
@@ -114,12 +109,12 @@ Where the file *create-instance.yml* is:
114
109
1. Select **Create** unless you want to configure advanced settings for the compute instance.
115
110
1. <aname="advanced-settings"></a> Select **Next: Advanced Settings** if you want to:
116
111
117
-
* Enable idle shutdown (preview). Configure a compute instance to automatically shut down if it's inactive. For more information, see [enable idle shutdown](#enable-idle-shutdown-preview).
112
+
* Enable idle shutdown. Configure a compute instance to automatically shut down if it's inactive. For more information, see [enable idle shutdown](#enable-idle-shutdown).
118
113
* Add schedule. Schedule times for the compute instance to automatically start and/or shut down. See [schedule details](#schedule-automatic-start-and-stop) below.
* Enable virtual network. Specify the **Resource group**, **Virtual network**, and **Subnet** to create the compute instance inside an Azure Virtual Network (vnet). You can also select __No public IP__ to prevent the creation of a public IP address, which requires a private link workspace. You must also satisfy these [network requirements](./how-to-secure-training-vnet.md) for virtual network setup.
121
-
* Assign the computer to another user. For more about assigning to other users, see [Create on behalf of](#create-on-behalf-of-preview)
122
-
* Provision with a setup script (preview) - for more information about how to create and use a setup script, see [Customize the compute instance with a script](how-to-customize-compute-instance.md).
116
+
* Assign the computer to another user. For more about assigning to other users, see [Create on behalf of](#create-on-behalf-of)
117
+
* Provision with a setup script - for more information about how to create and use a setup script, see [Customize the compute instance with a script](how-to-customize-compute-instance.md).
123
118
124
119
You can also create a compute instance with an [Azure Resource Manager template](https://github.com/Azure/azure-quickstart-templates/tree/master/quickstarts/microsoft.machinelearningservices/machine-learning-compute-create-computeinstance).
125
120
@@ -136,12 +131,7 @@ SSH access is disabled by default. SSH access can't be changed after creation.
136
131
137
132
---
138
133
139
-
## Create on behalf of (preview)
140
-
141
-
> [!IMPORTANT]
142
-
> Items marked (preview) below are currently in public preview.
143
-
> The preview version is provided without a service level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
144
-
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
134
+
## Create on behalf of
145
135
146
136
As an administrator, you can create a compute instance on behalf of a data scientist and assign the instance to them with:
147
137
@@ -166,12 +156,7 @@ The data scientist can start, stop, and restart the compute instance. They can u
166
156
* Posit Workbench (formerly RStudio Workbench)
167
157
* Integrated notebooks
168
158
169
-
## Enable idle shutdown (preview)
170
-
171
-
> [!IMPORTANT]
172
-
> Items marked (preview) below are currently in public preview.
173
-
> The preview version is provided without a service level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
174
-
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
159
+
## Enable idle shutdown
175
160
176
161
To avoid getting charged for a compute instance that is switched on but inactive, you can configure when to shut down your compute instance due to inactivity.
177
162
@@ -186,15 +171,7 @@ Activity on custom applications installed on the compute instance isn't consider
186
171
187
172
Also, if a compute instance has already been idle for a certain amount of time, if idle shutdown settings are updated to an amount of time shorter than the current idle duration, the idle time clock will be reset to 0. For example, if the compute instance has already been idle for 20 minutes, and the shutdown settings are updated to 15 minutes, the idle time clock will be reset to 0.
188
173
189
-
Use **Manage preview features** to access this feature.
190
-
191
-
1. In the workspace toolbar, select the **Manage preview features** image.
192
-
1. Scroll down until you see **Configure auto-shutdown for idle compute instances**.
Once enabled, the setting can be configured during compute instance creation or for existing compute instances via the following interfaces:
174
+
The setting can be configured during compute instance creation or for existing compute instances via the following interfaces:
198
175
199
176
# [Python SDK](#tab/python)
200
177
@@ -328,7 +305,7 @@ You can also create your own custom Azure policy. For example, if the below poli
328
305
329
306
Define multiple schedules for auto-shutdown and auto-start. For instance, create a schedule to start at 9 AM and stop at 6 PM from Monday-Thursday, and a second schedule to start at 9 AM and stop at 4 PM for Friday. You can create a total of four schedules per compute instance.
330
307
331
-
Schedules can also be defined for [create on behalf of](#create-on-behalf-of-preview) compute instances. You can create a schedule that creates the compute instance in a stopped state. Stopped compute instances are useful when you create a compute instance on behalf of another user.
308
+
Schedules can also be defined for [create on behalf of](#create-on-behalf-of) compute instances. You can create a schedule that creates the compute instance in a stopped state. Stopped compute instances are useful when you create a compute instance on behalf of another user.
332
309
333
310
Prior to a scheduled shutdown, users will see a notification alerting them that the Compute Instance is about to shut down. At that point, the user can choose to dismiss the upcoming shutdown event, if for example they are in the middle of using their Compute Instance.
334
311
@@ -582,12 +559,7 @@ az login --identity --username $DEFAULT_IDENTITY_CLIENT_ID
582
559
> [!NOTE]
583
560
> You cannot use ```azcopy``` when trying to use managed identity. ```azcopy login --identity``` will not work.
584
561
585
-
## Add custom applications such as RStudio or Posit Workbench (preview)
586
-
587
-
> [!IMPORTANT]
588
-
> Items marked (preview) below are currently in public preview.
589
-
> The preview version is provided without a service level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
590
-
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
562
+
## Add custom applications such as RStudio or Posit Workbench
591
563
592
564
You can set up other applications, such as RStudio, or Posit Workbench (formerly RStudio Workbench), when creating a compute instance. Follow these steps in studio to set up a custom application on your compute instance
593
565
@@ -753,7 +725,7 @@ For each compute instance in a workspace that you created (or that was created f
753
725
* SSH into compute instance. SSH access is disabled by default but can be enabled at compute instance creation time. SSH access is through public/private key mechanism. The tab will give you details for SSH connection such as IP address, username, and port number. In a virtual network deployment, disabling SSH prevents SSH access from public internet, you can still SSH from within virtual network using private IP address of compute instance node and port 22.
754
726
* Select the compute name to:
755
727
* View details about a specific compute instance such as IP address, and region.
756
-
* Create or modify the schedule for starting and stopping the compute instance (preview). Scroll down to the bottom of the page to edit the schedule.
728
+
* Create or modify the schedule for starting and stopping the compute instance. Scroll down to the bottom of the page to edit the schedule.
757
729
758
730
---
759
731
@@ -772,11 +744,11 @@ To create a compute instance, you'll need permissions for the following actions:
### Audit and observe compute instance version (preview)
747
+
### Audit and observe compute instance version
776
748
777
749
Once a compute instance is deployed, it does not get automatically updated. Microsoft [releases](azure-machine-learning-ci-image-release-notes.md) new VM images on a monthly basis. To understand options for keeping recent with the latest version, see [vulnerability management](concept-vulnerability-management.md#compute-instance).
778
750
779
-
To keep track of whether an instance's operating system version is current, you could query its version using the Studio UI. In your workspace in Azure Machine Learning studio, select Compute, then select compute instance on the top. Select a compute instance's compute name to see its properties including the current operating system. Enable 'audit and observe compute instance os version' under the previews management panel to see these preview properties.
751
+
To keep track of whether an instance's operating system version is current, you could query its version using the Studio UI. In your workspace in Azure Machine Learning studio, select Compute, then select compute instance on the top. Select a compute instance's compute name to see its properties including the current operating system.
780
752
781
753
Administrators can use [Azure Policy](./../governance/policy/overview.md) definitions to audit instances that are running on outdated operating system versions across workspaces and subscriptions. The following is a sample policy:
0 commit comments