You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-`<LOG_ANALYTICS_WORKSPACE_KEY>`: Log Analytics key. To find this, in the Azure portal, go to **Azure Log Analytics workspace** > **Agents** > **Primary key**.
To configure a Key Vault linked service in Synapse Studio to store the workspace key, follow these steps:
82
83
83
84
1. Follow all the steps in the preceding section, "Option 2."
84
-
2. Create a Key Vault linked service in Synapse Studio:
85
+
1. Create a Key Vault linked service in Synapse Studio:
85
86
86
87
a. Go to **Synapse Studio** > **Manage** > **Linked services**, and then select **New**.
87
88
@@ -91,7 +92,7 @@ To configure a Key Vault linked service in Synapse Studio to store the workspace
91
92
92
93
d. Choose your key vault, and select **Create**.
93
94
94
-
3. Add a `spark.synapse.logAnalytics.keyVault.linkedServiceName` item to the Apache Spark configuration.
95
+
1. Add a `spark.synapse.logAnalytics.keyVault.linkedServiceName` item to the Apache Spark configuration.
95
96
96
97
```properties
97
98
spark.synapse.logAnalytics.enabled true
@@ -104,18 +105,21 @@ For a list of Apache Spark configurations, see [Available Apache Spark configura
104
105
105
106
### Step 3: Create an Apache Spark Configuration
106
107
107
-
You can create an Apache Spark Configuration to your workspace, and when you create Notebook or Apache spark job definition can select the Apache Spark configuration that you want to use with your Apache Spark pool. When you select it, the details of the configuration are displayed.
108
+
You can create an Apache Spark Configuration to your workspace, and when you create Notebook or Apache spark job definition you can select the Apache Spark configuration that you want to use with your Apache Spark pool. When you select it, the details of the configuration are displayed.
2. Click on **New** button to create a new Apache Spark configuration, or click on **Import** a local .json file to your workspace.
111
-
3.**New Apache Spark configuration** page will be opened after you click on **New** button.
112
-
4. For **Name**, you can enter your preferred and valid name.
113
-
5. For **Description**, you can input some description in it.
114
-
6. For **Annotations**, you can add annotations by clicking the **New** button, and also you can delete existing annotations by selecting and clicking **Delete** button.
115
-
7. For **Configuration properties**, customize the configuration by clicking **Add** button to add properties. If you do not add a property, Azure Synapse will use the default value when applicable.
111
+
1. Select **New** button to create a new Apache Spark configuration.
112
+
1.**New Apache Spark configuration** page will be opened after you select **New** button.
116
113
117
114

118
115
116
+
1. For **Name**, you can enter your preferred and valid name.
117
+
1. For **Description**, you can input some description in it.
118
+
1. For **Annotations**, you can add annotations by clicking the **New** button, and also you can delete existing annotations by selecting and clicking **Delete** button.
119
+
1. For **Configuration properties**, add all the properties from the configuration option you chose by selecting the **Add** button. For **Property** add the property name as listed, and for **Value** use the value you gathered during step 2. If you don't add a property, Azure Synapse will use the default value when applicable.
120
+
121
+

122
+
119
123
## Submit an Apache Spark application and view the logs and metrics
120
124
121
125
Here's how:
@@ -214,8 +218,6 @@ SparkMetrics_CL
214
218
| order by TimeGenerated asc
215
219
```
216
220
217
-
218
-
219
221
## Create and manage alerts
220
222
221
223
Users can query to evaluate metrics and logs at a set frequency, and fire an alert based on the results. For more information, see [Create, view, and manage log alerts by using Azure Monitor](/azure/azure-monitor/alerts/alerts-log).
@@ -228,25 +230,23 @@ When you want to enable this feature, you need to create managed private endpoin
228
230
229
231
You can follow below steps to create a managed private endpoint connection to Azure Monitor private link scopes (A M P L S):
230
232
231
-
1. If there is no existing A M P L S, you can follow [Azure Monitor Private Link connection setup](/azure/azure-monitor/logs/private-link-security) to create one.
232
-
2. Navigate to your A M P L S in Azure portal, on the **Azure Monitor Resources** page, click**Add** to add connection to your Azure Log Analytics workspace.
233
-
3. Navigate to **Synapse Studio > Manage > Managed private endpoints**, click**New** button, select **Azure Monitor Private Link Scopes**, and **continue**.
233
+
1. If there's no existing A M P L S, you can follow [Azure Monitor Private Link connection setup](/azure/azure-monitor/logs/private-link-security) to create one.
234
+
1. Navigate to your A M P L S in Azure portal, on the **Azure Monitor Resources** page, select**Add** to add connection to your Azure Log Analytics workspace.
235
+
1. Navigate to **Synapse Studio > Manage > Managed private endpoints**, select**New** button, select **Azure Monitor Private Link Scopes**, and **continue**.
234
236
> [!div class="mx-imgBorder"]
235
237
> 
236
-
4. Choose your Azure Monitor Private Link Scope you created, and click**Create** button.
238
+
1. Choose your Azure Monitor Private Link Scope you created, and select**Create** button.
237
239
> [!div class="mx-imgBorder"]
238
240
> 
239
-
5. Wait a few minutes for private endpoint provisioning.
240
-
6. Navigate to your A M P L S in Azure portal again, on the **Private Endpoint connections** page, select the connection provisioned and **Approve**.
241
+
1. Wait a few minutes for private endpoint provisioning.
242
+
1. Navigate to your A M P L S in Azure portal again, on the **Private Endpoint connections** page, select the connection provisioned and **Approve**.
241
243
242
-
> [!NOTE]
244
+
> [!NOTE]
243
245
> - The A M P L S object has a number of limits you should consider when planning your Private Link setup. See [A M P L S limits](/azure/azure-monitor/logs/private-link-security) for a deeper review of these limits.
244
246
> - Check if you have [right permission](../security/synapse-workspace-access-control-overview.md) to create managed private endpoint.
245
247
246
-
## Next steps
248
+
## Related content
247
249
248
-
-[Use serverless Apache Spark pool in Synapse Studio](../quickstart-create-apache-spark-pool-studio.md).
249
250
-[Run a Spark application in notebook](./apache-spark-development-using-notebooks.md).
250
-
-[Create Apache Spark job definition in Azure Studio](./apache-spark-job-definitions.md).
251
251
-[Collect Apache Spark applications logs and metrics with Azure Storage account](./azure-synapse-diagnostic-emitters-azure-storage.md).
252
252
-[Collect Apache Spark applications logs and metrics with Azure Event Hubs](./azure-synapse-diagnostic-emitters-azure-eventhub.md).
0 commit comments