You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/spark/apache-spark-azure-log-analytics.md
+3-25Lines changed: 3 additions & 25 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,9 +7,10 @@ ms.reviewer: whhender
7
7
ms.service: azure-synapse-analytics
8
8
ms.topic: tutorial
9
9
ms.subservice: spark
10
-
ms.date: 03/25/2021
10
+
ms.date: 12/02/2024
11
11
ms.custom: references_regions
12
12
---
13
+
13
14
# Monitor Apache Spark applications with Azure Log Analytics
14
15
15
16
In this tutorial, you learn how to enable the Synapse Studio connector that's built in to Log Analytics. You can then collect and send Apache Spark application metrics and logs to your [Log Analytics workspace](/azure/azure-monitor/logs/quick-create-workspace). Finally, you can use an Azure Monitor workbook to visualize the metrics and logs.
@@ -95,36 +96,13 @@ To configure a Key Vault linked service in Synapse Studio to store the workspace
For a list of Apache Spark configurations, see [Available Apache Spark configurations](../monitor-synapse-analytics-reference.md#available-apache-spark-configurations)
104
104
105
-
### Step 3: Upload your Apache Spark configuration to an Apache Spark pool
106
-
107
-
> [!NOTE]
108
-
>
109
-
> This step will be replaced by step 4.
110
-
111
-
You can upload the configuration file to your Azure Synapse Analytics Apache Spark pool. In Synapse Studio:
112
-
113
-
1. Select **Manage** > **Apache Spark pools**.
114
-
2. Next to your Apache Spark pool, select the **...** button.
115
-
3. Select **Apache Spark configuration**.
116
-
4. Select **Upload**, and choose the *spark_loganalytics_conf.txt* file.
117
-
5. Select **Upload**, and then select **Apply**.
118
-
119
-
> [!div class="mx-imgBorder"]
120
-
> 
121
-
122
-
> [!NOTE]
123
-
>
124
-
> All the Apache Spark applications submitted to the Apache Spark pool will use the configuration setting to push the Apache Spark application metrics and logs to your specified workspace.
125
-
126
-
127
-
### Step 4: Create an Apache Spark Configuration
105
+
### Step 3: Create an Apache Spark Configuration
128
106
129
107
You can create an Apache Spark Configuration to your workspace, and when you create Notebook or Apache spark job definition can select the Apache Spark configuration that you want to use with your Apache Spark pool. When you select it, the details of the configuration are displayed.
0 commit comments