Skip to content

Commit 1d8a082

Browse files
committed
Initial updates
1 parent 885d7ba commit 1d8a082

File tree

1 file changed

+3
-25
lines changed

1 file changed

+3
-25
lines changed

articles/synapse-analytics/spark/apache-spark-azure-log-analytics.md

Lines changed: 3 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -7,9 +7,10 @@ ms.reviewer: whhender
77
ms.service: azure-synapse-analytics
88
ms.topic: tutorial
99
ms.subservice: spark
10-
ms.date: 03/25/2021
10+
ms.date: 12/02/2024
1111
ms.custom: references_regions
1212
---
13+
1314
# Monitor Apache Spark applications with Azure Log Analytics
1415

1516
In this tutorial, you learn how to enable the Synapse Studio connector that's built in to Log Analytics. You can then collect and send Apache Spark application metrics and logs to your [Log Analytics workspace](/azure/azure-monitor/logs/quick-create-workspace). Finally, you can use an Azure Monitor workbook to visualize the metrics and logs.
@@ -95,36 +96,13 @@ To configure a Key Vault linked service in Synapse Studio to store the workspace
9596
```properties
9697
spark.synapse.logAnalytics.enabled true
9798
spark.synapse.logAnalytics.workspaceId <LOG_ANALYTICS_WORKSPACE_ID>
98-
spark.synapse.logAnalytics.keyVault.name <AZURE_KEY_VAULT_NAME>
9999
spark.synapse.logAnalytics.keyVault.key.secret <AZURE_KEY_VAULT_SECRET_KEY_NAME>
100100
spark.synapse.logAnalytics.keyVault.linkedServiceName <LINKED_SERVICE_NAME>
101101
```
102102

103103
For a list of Apache Spark configurations, see [Available Apache Spark configurations](../monitor-synapse-analytics-reference.md#available-apache-spark-configurations)
104104

105-
### Step 3: Upload your Apache Spark configuration to an Apache Spark pool
106-
107-
> [!NOTE]
108-
>
109-
> This step will be replaced by step 4.
110-
111-
You can upload the configuration file to your Azure Synapse Analytics Apache Spark pool. In Synapse Studio:
112-
113-
1. Select **Manage** > **Apache Spark pools**.
114-
2. Next to your Apache Spark pool, select the **...** button.
115-
3. Select **Apache Spark configuration**.
116-
4. Select **Upload**, and choose the *spark_loganalytics_conf.txt* file.
117-
5. Select **Upload**, and then select **Apply**.
118-
119-
> [!div class="mx-imgBorder"]
120-
> ![Screenshot that shows the Spark pool configuration.](./media/apache-spark-azure-log-analytics/spark-pool-configuration.png)
121-
122-
> [!NOTE]
123-
>
124-
> All the Apache Spark applications submitted to the Apache Spark pool will use the configuration setting to push the Apache Spark application metrics and logs to your specified workspace.
125-
126-
127-
### Step 4: Create an Apache Spark Configuration
105+
### Step 3: Create an Apache Spark Configuration
128106

129107
You can create an Apache Spark Configuration to your workspace, and when you create Notebook or Apache spark job definition can select the Apache Spark configuration that you want to use with your Apache Spark pool. When you select it, the details of the configuration are displayed.
130108

0 commit comments

Comments
 (0)