You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/interactive-data-wrangling-with-apache-spark-azure-ml.md
+3-19Lines changed: 3 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -124,27 +124,11 @@ Data in the Azure storage account should become accessible once the user identit
124
124
125
125
Azure Machine Learning offers Managed (Automatic) Spark compute, and [attached Synapse Spark pool](./how-to-manage-synapse-spark-pool.md), for interactive data wrangling with Apache Spark, in Azure Machine Learning Notebooks. The Managed (Automatic) Spark compute does not require creation of resources in the Azure Synapse workspace. Instead, a fully managed automatic Spark compute becomes directly available in the Azure Machine Learning Notebooks. Using a Managed (Automatic) Spark compute is the easiest approach to access a Spark cluster in Azure Machine Learning.
126
126
127
-
### Create and configure Managed (Automatic) Spark compute in Azure Machine Learning Notebooks
127
+
### Managed (Automatic) Spark compute in Azure Machine Learning Notebooks
128
128
129
-
We can create a Managed (Automatic) Spark compute from the Machine Learning Notebooks user interface. To create a notebook, a first-time user should select **Notebooks** from the left panel in Azure Machine Learning studio, and then select **Start with an empty notebook**. Azure Machine Learning studio offers additional options to upload existing notebooks, and to clone notebooks from a git repository.
129
+
A Managed (Automatic) Spark compute is available in Azure Machine Learning Notebooks by default. To access it in a notebook, select **AzureML Spark Compute** under **Azure Machine Learning Spark**from the **Compute** selection menu.
130
130
131
-
:::image type="content" source="media/interactive-data-wrangling-with-apache-spark-azure-ml/start-with-an-empty-notebook.png" alt-text="Screenshot showing the Azure Notebooks tab.":::
132
-
133
-
To create and configure a Managed (Automatic) Spark compute in an open notebook:
134
-
135
-
1. Select the ellipses **(…)** next to the **Compute** selection menu.
136
-
1. Select **+ Create Azure ML compute**. Sometimes, the ellipses may not appear. In this case, directly select the **+** icon next to the **Compute** selection menu.
137
-
138
-
:::image type="content" source="media/interactive-data-wrangling-with-apache-spark-azure-ml/create-azure-ml-compute-resource-in-a-notebook.png" alt-text="Screenshot highlighting the Create Azure ML compute option of a specific Azure Notebook tab.":::
139
-
140
-
1. Select **Azure Machine Learning Spark**.
141
-
1. Select **Create**.
142
-
143
-
:::image type="content" source="media/interactive-data-wrangling-with-apache-spark-azure-ml/add-azure-machine-learning-spark-compute-type.png" alt-text="Screenshot highlighting the Azure Machine Learning Spark option at the Add new compute type screen.":::
144
-
145
-
1. Under **Azure Machine Learning Spark**, select **AzureML Spark Compute** from the **Compute** selection menu
146
-
147
-
:::image type="content" source="media/interactive-data-wrangling-with-apache-spark-azure-ml/select-azure-ml-spark-compute.png" alt-text="Screenshot highlighting the selected Azure Machine Learning Spark option at the Add new compute type screen.":::
131
+
:::image type="content" source="media/interactive-data-wrangling-with-apache-spark-azure-ml/select-azure-ml-spark-compute.png" alt-text="Screenshot highlighting the selected Azure Machine Learning Spark option at the Compute selection menu.":::
148
132
149
133
The Notebooks UI also provides options for Spark session configuration, for the Managed (Automatic) Spark compute. To configure a Spark session:
0 commit comments