You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/machine-learning/tutorial-load-data-petastorm.md
+10-6Lines changed: 10 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
title: 'Load data with Petastorm'
2
+
title: 'Load data with Petastorm (deprecated)'
3
3
description: This article provides a conceptual overview of how to load data with Petastorm.
4
4
author: midesa
5
5
ms.service: synapse-analytics
@@ -9,7 +9,7 @@ ms.date: 05/02/2024
9
9
ms.author: midesa
10
10
---
11
11
12
-
# Load data with Petastorm (Preview)
12
+
# Load data with Petastorm (deprecated)
13
13
14
14
Petastorm is an open source data access library, which enables single-node or distributed training of deep learning models. This library enables training directly from datasets in Apache Parquet format and datasets that are loaded as an Apache Spark DataFrame. Petastorm supports popular training frameworks such as Tensorflow and PyTorch.
15
15
@@ -20,9 +20,13 @@ For more information about Petastorm, you can visit the [Petastorm GitHub page](
20
20
-[Azure Synapse Analytics workspace](../get-started-create-workspace.md) with an Azure Data Lake Storage Gen2 storage account configured as the default storage. You need to be the *Storage Blob Data Contributor* of the Data Lake Storage Gen2 file system that you work with.
21
21
- Create a GPU-enabled Apache Spark pool in your Azure Synapse Analytics workspace. For details, see [Create a GPU-enabled Apache Spark pool in Azure Synapse](../spark/apache-spark-gpu-concept.md). For this tutorial, we suggest using the GPU-Large cluster size with 3 nodes.
22
22
23
-
> [!WARNING]
24
-
> - The GPU accelerated preview is limited to the [Apache Spark 3.2 (End of Support announced)](../spark/apache-spark-32-runtime.md) runtime. End of Support announced for Azure Synapse Runtime for Apache Spark 3.2 has been announced July 8, 2023. End of Support announced runtimes will not have bug and feature fixes. Security fixes will be backported based on risk assessment. This runtime and the corresponding GPU accelerated preview on Spark 3.2 will be retired and disabled as of July 8, 2024.
25
-
> - The GPU accelerated preview is now unsupported on the [Azure Synapse 3.1 (unsupported) runtime](../spark/apache-spark-3-runtime.md). Azure Synapse Runtime for Apache Spark 3.1 has reached its End of Support as of January 26, 2023, with official support discontinued effective January 26, 2024, and no further addressing of support tickets, bug fixes, or security updates beyond this date.
23
+
> [!NOTE]
24
+
> The Preview for Azure Synapse GPU-enabled pools has now been deprecated.
25
+
26
+
> [!CAUTION]
27
+
> Deprecation and disablement notification for GPUs on the Azure Synapse Runtime for Apache Spark 3.1 and 3.2
28
+
> - The GPU accelerated preview is now deprecated on the [Apache Spark 3.2 (deprecated) runtime](../spark/apache-spark-32-runtime.md). Deprecated runtimes will not have bug and feature fixes. This runtime and the corresponding GPU accelerated preview on Spark 3.2 has been retired and disabled as of July 8, 2024.
29
+
> - The GPU accelerated preview is now deprecated on the [Azure Synapse 3.1 (deprecated) runtime](../spark/apache-spark-3-runtime.md). Azure Synapse Runtime for Apache Spark 3.1 has reached its end of support as of January 26, 2023, with official support discontinued effective January 26, 2024, and no further addressing of support tickets, bug fixes, or security updates beyond this date.
26
30
27
31
28
32
## Configure the Apache Spark session
@@ -265,4 +269,4 @@ for epoch in range(1, loop_epochs + 1):
265
269
## Next steps
266
270
267
271
*[Check out Synapse sample notebooks](https://github.com/Azure-Samples/Synapse/tree/main/MachineLearning)
268
-
*[Learn more about GPU-enabled Apache Spark pools](../spark/apache-spark-gpu-concept.md)
272
+
*[Learn more about GPU-enabled Apache Spark pools](../spark/apache-spark-gpu-concept.md)
0 commit comments