You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/quickstart-create-apache-spark-pool-studio.md
+19-20Lines changed: 19 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -39,7 +39,7 @@ Sign in to the [Azure portal](https://portal.azure.com/)
39
39
1. From the list of workspaces, type the name (or part of the name) of the workspace to open. For this example, we'll use a workspace named **contosoanalytics**.
40
40
41
41

42
-
42
+
43
43
## Launch Synapse Studio
44
44
45
45
From the workspace overview, select the **Workspace web URL** to open Synapse Studio.
@@ -48,31 +48,30 @@ From the workspace overview, select the **Workspace web URL** to open Synapse St
48
48
49
49
## Create the Apache Spark pool in Synapse Studio
50
50
> [!IMPORTANT]
51
-
> Azure Synapse Runtime for Apache Spark 3.1 and 3.2 have reached their end of support. 3.1 had reached its end of support on January 26, 2023, with official support discontinued effective January 26, 2024, and no further addressing of support tickets, bug fixes, or security updates beyond this date. 3.2 had reached its end of support as of July 8, 2023, with no further bug or feature fixes, but security fixes may be backported based on risk assessment, and it will be retired and disabled as of July 8, 2024.
52
-
51
+
> Azure Synapse Runtime for Apache Spark 2.4 has been deprecated and officially not supported since 09/29/2023. Given [Spark 3.1](/azure/synapse-analytics/spark/apache-spark-3-runtime) and [Spark 3.2](/azure/synapse-analytics/spark/apache-spark-32-runtime) are also End of Life announced (EOLA), we recommend customers migrate to Spark 3.3. Please refer to [this link](/azure/synapse-analytics/spark/apache-spark-33-runtime) for a migration guide.
53
52
1. On the Synapse Studio home page, navigate to the **Management Hub** in the left navigation by selecting the **Manage** icon.
54
53
55
54

56
-
55
+
57
56
1. Once in the Management Hub, navigate to the **Apache Spark pools** section to see the current list of Apache Spark pools that are available in the workspace.
58
-
59
-

60
57
58
+

59
+
61
60
1. Select **+ New** and the new Apache Spark pool create wizard will appear.
62
61
63
62
1. Enter the following details in the **Basics** tab:
64
63
65
-
| Setting | Suggested value | Description |
66
-
| :------ | :-------------- | :---------- |
67
-
|**Apache Spark pool name**| contosospark | This is the name that the Apache Spark pool will have. |
68
-
|**Node size**| Small (4 vCPU / 32 GB) | Set this to the smallest size to reduce costs for this quickstart |
69
-
|**Autoscale**| Disabled | We won't need autoscale in this quickstart |
70
-
|**Number of nodes**| 8 | Use a small size to limit costs in this quickstart|
71
-
|**Dynamically allocate executors**| Disabled | This setting maps to the dynamic allocation property in Spark configuration for Spark Application executors allocation. We won't need autoscale in this quickstart.|
72
-
64
+
| Setting | Suggested value | Description |
65
+
| :------ | :-------------- | :---------- |
66
+
|**Apache Spark pool name**| contosospark | This is the name that the Apache Spark pool will have. |
67
+
|**Node size**| Small (4 vCPU / 32 GB) | Set this to the smallest size to reduce costs for this quickstart |
68
+
|**Autoscale**| Disabled | We won't need autoscale in this quickstart |
69
+
|**Number of nodes**| 8 | Use a small size to limit costs in this quickstart|
70
+
|**Dynamically allocate executors**| Disabled | This setting maps to the dynamic allocation property in Spark configuration for Spark Application executors allocation. We won't need autoscale in this quickstart.|
71
+
73
72

74
-
75
-
> [!IMPORTANT]
73
+
74
+
> [!IMPORTANT]
76
75
> Note that there are specific limitations for the names that Apache Spark pools can use. Names must contain letters or numbers only, must be 15 or less characters, must start with a letter, not contain reserved words, and be unique in the workspace.
77
76
78
77
1. In the next tab (Additional settings), leave all settings as defaults.
@@ -82,13 +81,13 @@ From the workspace overview, select the **Workspace web URL** to open Synapse St
82
81
1. In the **Review + create** tab, make sure that the details look correct based on what was previously entered, and press **Create**.
83
82
84
83

85
-
84
+
86
85
1. The Apache Spark pool will start the provisioning process.
87
86
88
87
1. Once the provisioning is complete, the new Apache Spark pool will appear in the list.
89
-
90
-

91
88
89
+

90
+
92
91
## Clean up Apache Spark pool resources using Synapse Studio
93
92
94
93
Follow the steps below to delete the Apache Spark pool from the workspace using Synapse Studio.
@@ -101,7 +100,7 @@ If you want to delete the Apache Spark pool, do the following:
101
100
1. Select the ellipsis next to the Apache pool to be deleted (in this case, **contosospark**) to show the commands for the Apache Spark pool.
102
101
103
102

104
-
103
+
105
104
1. Press **delete**.
106
105
1. Confirm the deletion, and press **Delete** button.
107
106
1. When the process completes successfully, the Apache Spark pool will no longer be listed in the workspace resources.
0 commit comments