You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
### Step 3: Upload your Spark configuration to a Spark pool
124
124
You can upload the configuration file to your Synapse Spark pool in Synapse Studio.
125
-
- Navigate to your Apache Spark pool in the Azure Synapse Studio (Manage -> Apache Spark pools)
126
-
- Click the **"..."** button on the right of your Apache Spark pool
127
-
- Select Apache Spark configuration
128
-
- Click **Upload** and choose the **"spark_loganalytics_conf.txt"** created.
129
-
- Click **Upload** and **Apply**.
130
125
131
-
> [!div class="mx-imgBorder"]
132
-
> 
126
+
1. Navigate to your Apache Spark pool in the Azure Synapse Studio (Manage -> Apache Spark pools)
127
+
2. Click the **"..."** button on the right of your Apache Spark pool
128
+
3. Select Apache Spark configuration
129
+
4. Click **Upload** and choose the **"spark_loganalytics_conf.txt"** created.
130
+
5. Click **Upload** and **Apply**.
131
+
132
+
> [!div class="mx-imgBorder"]
133
+
> 
133
134
134
135
> [!NOTE]
135
136
>
136
137
> All the Spark application submitted to the Spark pool above will use the configuration setting to push the Spark application metrics and logs to your specified Azure Log Analytics workspace.
137
138
138
139
## Submit a Spark application and view the logs and metrics in Azure Log Analytics
139
140
140
-
1) You can submit a Spark application to the Spark pool configured in the previous step, using one of the following ways:
141
+
1. You can submit a Spark application to the Spark pool configured in the previous step, using one of the following ways:
141
142
- Run a Synapse Studio notebook.
142
143
- Submit a Synapse Apache Spark batch job through Spark job definition.
143
144
- Run a Pipeline that contains Spark activity.
144
145
145
-
2) Go to the specified Azure Log Analytics Workspace, then view the application metrics and logs when the Spark application starts to run.
146
+
2. Go to the specified Azure Log Analytics Workspace, then view the application metrics and logs when the Spark application starts to run.
146
147
147
148
## Use the Sample Azure Log Analytics Workbook to visualize the metrics and logs
0 commit comments