Skip to content

Commit 121d90b

Browse files
committed
trying to fix redirection issue
1 parent a58ff57 commit 121d90b

File tree

2 files changed

+107
-1
lines changed

2 files changed

+107
-1
lines changed

articles/synapse-analytics/.openpublishing.redirection.synapse-analytics.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
"redirections": [
33
{
44
"source_path": "/articles/synapse-analytics/quickstart-create-apache-gpu-pool-portal.md",
5-
"redirect_url": "/azure/synapse-analytics/spark",
5+
"redirect_url": "/azure/synapse-analytics/quickstart-apache-spark-notebook",
66
"redirect_document_id": true
77
},
88
{
Lines changed: 106 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,106 @@
1+
---
2+
title: 'Quickstart: Create a serverless Apache Spark GPU pool'
3+
description: Create a serverless Apache Spark GPU pool using the Azure portal by following the steps in this guide.
4+
author: midesa
5+
ms.service: synapse-analytics
6+
ms.topic: quickstart
7+
ms.subservice: spark
8+
ms.date: 10/18/2021
9+
ms.author: midesa
10+
ms.custom: mode-ui
11+
---
12+
13+
# Quickstart: Create an Apache Spark GPU-enabled Pool in Azure Synapse Analytics using the Azure portal
14+
15+
An Apache Spark pool provides open-source big data compute capabilities where data can be loaded, modeled, processed, and distributed for faster analytic insight. Synapse now offers the ability to create Apache Spark pools that use GPUs on the backend to run your Spark workloads on GPUs for accelerated processing.
16+
17+
In this quickstart, you learn how to use the Azure portal to create an Apache Spark GPU-enabled pool in an Azure Synapse Analytics workspace.
18+
19+
> [!WARNING]
20+
> - The GPU accelerated preview is limited to the [Azure Synapse 3.1 (unsupported)](./spark/apache-spark-3-runtime.md) and [Apache Spark 3.2 (End of Support announced)](./spark/apache-spark-32-runtime.md) runtimes.
21+
> - Azure Synapse Runtime for Apache Spark 3.1 has reached its end of support as of January 26, 2023, with official support discontinued effective January 26, 2024, and no further addressing of support tickets, bug fixes, or security updates beyond this date.
22+
> - End of support announced for Azure Synapse Runtime for Apache Spark 3.2 has been announced July 8, 2023. End of support announced runtimes will not have bug and feature fixes. Security fixes will be backported based on risk assessment. This runtime will be retired and disabled as of July 8, 2024.
23+
24+
> [!NOTE]
25+
> Azure Synapse GPU-enabled pools are currently in Public Preview.
26+
27+
If you don't have an Azure subscription, [create a free account before you begin](https://azure.microsoft.com/free/).
28+
29+
## Prerequisites
30+
31+
- You'll need an Azure subscription. If needed, [create a free Azure account](https://azure.microsoft.com/free/)
32+
- [Synapse Analytics workspace](quickstart-create-workspace.md)
33+
34+
## Sign in to the Azure portal
35+
36+
Sign in to the [Azure portal](https://portal.azure.com/)
37+
38+
## Navigate to the Synapse workspace
39+
1. Navigate to the Synapse workspace where the Apache Spark pool will be created by typing the service name (or resource name directly) into the search bar.
40+
![Azure portal search bar with Synapse workspaces typed in.](media/quickstart-create-sql-pool/create-sql-pool-00a.png)
41+
2. From the list of workspaces, type the name (or part of the name) of the workspace to open. For this example, we'll use a workspace named **contosoanalytics**.
42+
![Listing of Synapse workspaces filtered to show those containing the name Contoso.](media/quickstart-create-sql-pool/create-sql-pool-00b.png)
43+
44+
45+
## Create new Azure Synapse GPU-enabled pool
46+
47+
1. In the Synapse workspace where you want to create the Apache Spark pool, select **New Apache Spark pool**.
48+
![Overview of Synapse workspace with a red box around the command to create a new Apache Spark pool](media/quickstart-create-apache-spark-pool/create-spark-pool-portal-01.png)
49+
2. Enter the following details in the **Basics** tab:
50+
51+
|Setting | Suggested value | Description |
52+
| :------ | :-------------- | :---------- |
53+
| **Apache Spark pool name** | A valid pool name | This is the name that the Apache Spark pool will have. |
54+
| **Node size family** | Hardware Accelerated | Choose Hardware Accelerated from the drop-down menu |
55+
| **Node size** | Large (16 vCPU / 110 GB / 1 GPU) | Set this to the smallest size to reduce costs for this quickstart |
56+
| **Autoscale** | Disabled | We don't need autoscale for this quickstart |
57+
| **Number of nodes** | 3 | Use a small size to limit costs for this quickstart |
58+
59+
60+
![Apache Spark pool create flow - basics tab.](media/quickstart-create-apache-spark-pool/create-spark-gpu-pool-portal-01.png)
61+
> [!IMPORTANT]
62+
> Note that there are specific limitations for the names that Apache Spark pools can use. Names must contain letters or numbers only, must be 15 or less characters, must start with a letter, not contain reserved words, and be unique in the workspace.
63+
64+
3. Select **Next: additional settings** and review the default settings. Do not modify any default settings. Note that GPU pools can **only be created with Apache Spark 3.1**.
65+
![Screenshot that shows the "Create Apache Spark pool" page with the "Additional settings" tab selected.](media/quickstart-create-apache-spark-pool/create-spark-gpu-pool-portal-02.png)
66+
67+
4. Select **Next: tags**. Don't add any tags.
68+
69+
![Apache Spark pool create flow - additional settings tab.](media/quickstart-create-apache-spark-pool/create-spark-pool-03-tags.png)
70+
71+
5. Select **Review + create**.
72+
73+
6. Make sure that the details look correct based on what was previously entered, and select **Create**.
74+
![Apache Spark pool create flow - review settings tab.](media/quickstart-create-apache-spark-pool/create-spark-gpu-pool-portal-03.png)
75+
76+
7. At this point, the resource provisioning flow will start, indicating once it's complete.
77+
![Screenshot that shows the "Overview" page with a "Your deployment is complete" message displayed.](media/quickstart-create-apache-spark-pool/create-spark-pool-portal-06.png)
78+
79+
8. After the provisioning completes, navigating back to the workspace will show a new entry for the newly created Azure Synapse GPU-enabled pool.
80+
![Apache Spark pool create flow - resource provisioning.](media/quickstart-create-apache-spark-pool/create-spark-gpu-pool-portal-04.png)
81+
82+
9. At this point, there are no resources running, no charges for Spark, you have created metadata about the Spark instances you want to create.
83+
84+
## Clean up resources
85+
86+
Follow the steps below to delete the Apache Spark pool from the workspace.
87+
> [!WARNING]
88+
> Deleting an Apache Spark pool will remove the analytics engine from the workspace. It will no longer be possible to connect to the pool, and all queries, pipelines, and notebooks that use this Apache Spark pool will no longer work.
89+
90+
If you want to delete the Apache Spark pool, do the following:
91+
92+
1. Navigate to the Apache Spark pools blade in the workspace.
93+
2. Select the Apache Spark pool to be deleted (in this case, **contosospark**).
94+
3. Press **delete**.
95+
96+
![Listing of Apache Spark pools, with the recently created pool selected.](media/quickstart-create-apache-spark-pool/create-spark-pool-portal-08.png)
97+
98+
4. Confirm the deletion, and press **Delete** button.
99+
100+
![Confirmation dialog to delete the selected Apache Spark pool.](media/quickstart-create-apache-spark-pool/create-spark-pool-portal-10.png)
101+
102+
5. When the process completes successfully, the Apache Spark pool will no longer be listed in the workspace resources.
103+
104+
## Next steps
105+
106+
- See [Quickstart: Create an Apache Spark notebook to run on a GPU pool](spark/apache-spark-rapids-gpu.md).

0 commit comments

Comments
 (0)