You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/spark/apache-spark-manage-workspace-packages.md
+6-6Lines changed: 6 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Learn how to add and manage libraries to workspace in Azure Synapse
4
4
author: shuaijunye
5
5
ms.service: azure-synapse-analytics
6
6
ms.topic: conceptual
7
-
ms.date: 11/03/2022
7
+
ms.date: 12/03/2024
8
8
ms.author: shuaijunye
9
9
ms.subservice: spark
10
10
---
@@ -15,8 +15,8 @@ Workspace packages can be custom or private wheel (Python), jar (Scala/Java), or
15
15
16
16
To add workspace packages:
17
17
1. Navigate to the **Manage** > **Workspace packages** tab.
18
-
2. Upload your wheel files by using the file selector.
19
-
3. Once the files have been uploaded to the Azure Synapse workspace, you can add these packages to a given Apache Spark pool.
18
+
2. Upload your files using the file selector.
19
+
3. Once the files have been uploaded to the Azure Synapse workspace, you can add these packages to an Apache Spark pool.
20
20
21
21
:::image type="content" source="./media/apache-spark-azure-portal-add-libraries/studio-add-workspace-package.png" alt-text="Screenshot that highlights workspace packages." lightbox="./media/apache-spark-azure-portal-add-libraries/studio-add-workspace-package.png":::
22
22
@@ -26,10 +26,10 @@ To add workspace packages:
26
26
>- Once Workspace Packages are used to install packages on a given Apache Spark pool, there is a limitation that you can no longer specify packages using the Storage account path on the same pool.
27
27
28
28
> [!NOTE]
29
-
> It's recommended that you don't have multiple wheel packages with the same name in a workspace. If you want to use a different version of the same wheel package, you have to delete the existing version and upload the new one.
29
+
> It's recommended that you don't have multiple packages with the same name in a workspace. If you want to use a different version of the same package, you have to delete the existing version and upload the new one.
30
30
31
31
## Storage account
32
-
Custom-built wheel packages can be installed on the Apache Spark pool by uploading all the wheel files into the Azure Data Lake Storage (Gen2) account that is linked with the Synapse workspace.
32
+
Custom-built packages can be installed on the Apache Spark pool by uploading all the files into the Azure Data Lake Storage (Gen2) account that is linked with the Synapse workspace.
33
33
34
34
The files should be uploaded to the following path in the storage account's default container:
> - In some cases, you may need to create the file path based on the structure above if it does not already exist. For example, you may need to add the ```python``` folder within the ```libraries``` folder if it does not already exist.
42
-
> - This method of managing custom wheel files will not be supported on the Azure Synapse Runtime for Apache Spark 3.0. Please refer to the Workspace packages feature to manage custom wheel files.
42
+
> - This method of managing custom files will not be supported on the Azure Synapse Runtime for Apache Spark 3.0. Please refer to the Workspace packages feature to manage custom files.
43
43
44
44
> [!IMPORTANT]
45
45
> To install custom libraries using the Azure DataLake Storage method, you must have the **Storage Blob Data Contributor** or **Storage Blob Data Owner** permissions on the primary Gen2 Storage account that is linked to the Azure Synapse Analytics workspace.
0 commit comments