You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/stream-analytics/cicd-tools.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -250,7 +250,7 @@ To deploy your Stream Analytics project using ARM templates, follow these steps:
250
250
-TemplateParameterFile $parameterFile
251
251
```
252
252
253
-
For more details about deploying resources with ARM templates, see [Deploy with a Resource Manager template file and Azure PowerShell](https://aka.ms/armdeploytemplate).
253
+
For more information about deploying resources with ARM templates, see [Deploy with a Resource Manager template file and Azure PowerShell](https://aka.ms/armdeploytemplate).
Copy file name to clipboardExpand all lines: articles/stream-analytics/optimize-query-using-job-diagram-simulator.md
+13-13Lines changed: 13 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,7 +11,7 @@ ms.date: 12/27/2022
11
11
12
12
# Optimize query using job diagram simulator
13
13
14
-
One way to improve the performance of an Azure Stream Analytics job is to apply parallelism in query. This article demonstrates how to use the Job Diagram Simulator in Visual Studio Code (VSCode) and evaluate the query parallelism for a Stream Analytics job. You learn to visualize a query execution with different number of streaming units and improve query parallelism based on the edit suggestions.
14
+
One way to improve the performance of an Azure Stream Analytics job is to apply parallelism in query. This article demonstrates how to use the Job Diagram Simulator in Visual Studio Code (VS Code) and evaluate the query parallelism for a Stream Analytics job. You learn to visualize a query execution with different number of streaming units and improve query parallelism based on the edit suggestions.
15
15
16
16
## What is parallel query?
17
17
@@ -26,46 +26,46 @@ If you want to learn more about query parallelization, see [Leverage query paral
26
26
The **Job diagram simulator** feature simulates the job running topology in Azure and provides suggestions for adjusting Streaming Units. Therefore, you must configure live inputs and outputs for your Stream Analytics job and use them in the query.
27
27
28
28
Prerequisites:
29
-
* ASA Tools extension for VSCode. If you haven't installed it yet, follow [this guide](quick-create-visual-studio-code.md) to install.
29
+
* ASA Tools extension for VS Code. If you haven't installed it yet, follow [this guide](quick-create-visual-studio-code.md) to install.
30
30
* Configure live input and live output for your Stream Analytics job.
31
31
* You must include live input and output in the query.
32
32
33
33
> [!NOTE]
34
34
> The Job diagram simulator can't simulate job running topology for local inputs and outputs. It doesn't send results to the output destination.
35
35
36
-
In this tutorial, you learn to improve query performance based on edit suggestions and make it executed in parallel. As an example, we're using a non-parallel job that takes the input data from an event hub and sends the results to another event hub.
36
+
In this tutorial, you learn to improve query performance based on edit suggestions and make it executed in parallel. As an example, we're using a nonparallel job that takes the input data from an event hub and sends the results to another event hub.
37
37
38
-
1. Open the Azure Stream Analytics project in VSCode after you finish your query authoring, go to the query file **\*.asaql** and select **Simulate job** to start the job diagram simulation.
38
+
1. Open the Azure Stream Analytics project in VS Code after you finish your query authoring, go to the query file **\*.asaql** and select **Simulate job** to start the job diagram simulation.
39
39
40
-
:::image type="content" source="./media/job-diagram-simulator/query-file-simulate-job.png" alt-text="Screenshot of the VSCode opening job diagram simulator in query file." lightbox= "./media/job-diagram-simulator/query-file-simulate-job.png" :::
40
+
:::image type="content" source="./media/job-diagram-simulator/query-file-simulate-job.png" alt-text="Screenshot of the VS Code opening job diagram simulator in query file." lightbox= "./media/job-diagram-simulator/query-file-simulate-job.png" :::
41
41
42
42
1. Under the **Diagram** tab, you can see the topology of the Azure Stream Analytics job. It shows the number of streaming nodes allocated to the job and the number of partitions in each streaming node. The below job diagram shows this job isn't in parallel since there's data interaction between the two nodes.
43
43
44
-
:::image type="content" source="./media/job-diagram-simulator/diagram-tab.png" alt-text="Screenshot of the VSCode using job diagram simulator and showing job topology." lightbox= "./media/job-diagram-simulator/diagram-tab.png" :::
44
+
:::image type="content" source="./media/job-diagram-simulator/diagram-tab.png" alt-text="Screenshot of the VS Code using job diagram simulator and showing job topology." lightbox= "./media/job-diagram-simulator/diagram-tab.png" :::
45
45
46
46
1. Since this query is **NOT** in parallel, you can select **Enhancements** tab and view suggestions about optimizing query parallelism.
47
47
48
-
:::image type="content" source="./media/job-diagram-simulator/edit-suggestions.png" alt-text="Screenshot of the VSCode using job diagram simulator and showing the query edit suggestions." lightbox= "./media/job-diagram-simulator/edit-suggestions.png" :::
48
+
:::image type="content" source="./media/job-diagram-simulator/edit-suggestions.png" alt-text="Screenshot of the VS Code using job diagram simulator and showing the query edit suggestions." lightbox= "./media/job-diagram-simulator/edit-suggestions.png" :::
49
49
50
50
1. Select query step in the enhancements list, you see the corresponding lines are highlighted and you can edit the query based on the suggestions.
51
51
52
-
:::image type="content" source="./media/job-diagram-simulator/query-highlight.png" alt-text="Screenshot of the VSCode using job diagram simulator and highlighting the query step." lightbox= "./media/job-diagram-simulator/query-highlight.png" :::
52
+
:::image type="content" source="./media/job-diagram-simulator/query-highlight.png" alt-text="Screenshot of the VS Code using job diagram simulator and highlighting the query step." lightbox= "./media/job-diagram-simulator/query-highlight.png" :::
53
53
54
54
> [!NOTE]
55
55
> These are edit suggestions for improving your query parallelism. However, if you are using aggregate function among all partitions, having a parallel query might not be applicable to your business scenarios.
56
56
57
-
1. For this example, you add the **PartitionId** to line#22 and save your change. Then you can use **Refresh simulation** to get the new diagram as below.
57
+
1. For this example, you add the **PartitionId** to line#22 and save your change. Then you can use **Refresh simulation** to get the new diagram.
58
58
59
59
:::image type="content" source="./media/job-diagram-simulator/refresh-simulation-after-update-query.png" alt-text="Screenshot that shows the refresh diagram after updating query." lightbox= "./media/job-diagram-simulator/refresh-simulation-after-update-query.png" :::
60
60
61
61
62
-
1. You can also adjust **Streaming Units** to stimulate how streaming nodes are allocated with different SUs. It will give you an idea of how many SUs you need to maximize the query performance.
62
+
1. You can also adjust **Streaming Units** to stimulate how streaming nodes are allocated with different SUs. It gives you an idea of how many SUs you need to maximize the query performance.
63
63
64
-
:::image type="content" source="./media/job-diagram-simulator/job-diagram-simulator-adjust-su.png" alt-text="Screenshot of the VSCode using SU adjuster." lightbox= "./media/job-diagram-simulator/job-diagram-simulator-adjust-su.png" :::
64
+
:::image type="content" source="./media/job-diagram-simulator/job-diagram-simulator-adjust-su.png" alt-text="Screenshot of the VS Code using SU adjuster." lightbox= "./media/job-diagram-simulator/job-diagram-simulator-adjust-su.png" :::
65
65
66
66
## Processor-level diagram
67
67
68
-
Once you have adjusted the streaming units to simulate the topology of your job, you can expand any of the streaming nodes to observe how your data is being processed at the processor level.
68
+
Once you've adjusted the streaming units to simulate the topology of your job, you can expand any of the streaming nodes to observe how your data is being processed at the processor level.
69
69
70
70
:::image type="content" source="./media/job-diagram-simulator/processor-level-simulator.gif" alt-text="A screenshot in gif format showing the processor level diagram of the simulator." lightbox= "./media/job-diagram-simulator/processor-level-simulator.gif" :::
71
71
@@ -87,7 +87,7 @@ Here are the explanations for Enhancements:
87
87
| Input partition keys not matched | All inputs must use the same partition key. |
0 commit comments