You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/event-hubs/process-data-azure-stream-analytics.md
+13-22Lines changed: 13 additions & 22 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,8 +1,9 @@
1
1
---
2
-
title: Process data from Event Hubs Azure using Stream Analytics | Microsoft Docs
2
+
title: Process data using Stream Analytics
3
3
description: This article shows you how to process data from your Azure event hub using an Azure Stream Analytics job.
4
-
ms.date: 05/22/2023
4
+
ms.date: 06/26/2024
5
5
ms.topic: how-to
6
+
#customer intent: As a developer, I want to know how process event data in an event hub using an Azure Stream Analytics job.
6
7
---
7
8
8
9
@@ -21,41 +22,31 @@ Here are the key benefits of Azure Event Hubs and Azure Stream Analytics integra
21
22
> [!IMPORTANT]
22
23
> - If you aren't a member of [owner](../role-based-access-control/built-in-roles.md#owner) or [contributor](../role-based-access-control/built-in-roles.md#contributor) roles at the Azure subscription level, you must be a member of the [Stream Analytics Query Tester](../role-based-access-control/built-in-roles.md#stream-analytics-query-tester) role at the Azure subscription level to successfully complete steps in this section. This role allows you to perform testing queries without creating a stream analytics job first. For instructions on assigning a role to a user, see [Assign AD roles to users](../active-directory/roles/manage-roles-portal.md).
23
24
> - If your event hub allows only the private access via private endpoints, you must have the Stream Analytics job joined to the same network so that the job can access events in the event hub.
25
+
24
26
1. Sign in to the [Azure portal](https://portal.azure.com).
25
27
1. Navigate to your **Event Hubs namespace** and then navigate to the **event hub**, which has the incoming data.
26
-
1. Select **Process Data** on the event hub page or select **Process data** on the left menu.
27
-
28
-
:::image type="content" source="./media/process-data-azure-stream-analytics/process-data-tile.png" alt-text="Screenshot showing the Process data page for the event hub." lightbox="./media/process-data-azure-stream-analytics/process-data-tile.png":::
29
-
1. Select **Start** on the **Enable real-time insights from events** tile.
28
+
1. On the left navigation menu, expand **Features**, and select **Process data**, and then select **Start** on the **Enable real time insights from events** tile.
30
29
31
30
:::image type="content" source="./media/process-data-azure-stream-analytics/process-data-page-explore-stream-analytics.png" alt-text="Screenshot showing the Process data page with Enable real time insights from events tile selected." lightbox="./media/process-data-azure-stream-analytics/process-data-page-explore-stream-analytics.png":::
32
-
1. You see a query page with values already set for the following fields:
31
+
1. You see a query page with values already set for the following fields. If you see a popup window about a consumer group and a policy being created for you, select **OK**. You immediately see a snapshot of the latest incoming data in this tab.
33
32
1. Your **event hub** as an input for the query.
34
33
1. Sample **SQL query** with SELECT statement.
35
34
1. An **output** alias to refer to your query test results.
36
35
37
-
:::image type="content" source="./media/process-data-azure-stream-analytics/query-editor.png" alt-text="Screenshot showing the Query editor for your Stream Analytics query." lightbox="./media/process-data-azure-stream-analytics/query-editor.png":::
38
-
39
-
> [!NOTE]
40
-
> When you use this feature for the first time, this page asks for your permission to create a consumer group and a policy for your event hub to preview incoming data.
41
-
1. Select **Create** in the **Input preview** pane as shown in the preceding image.
42
-
1. You immediately see a snapshot of the latest incoming data in this tab.
36
+
:::image type="content" source="./media/process-data-azure-stream-analytics/query-editor.png" alt-text="Screenshot showing the Query editor for your Stream Analytics query." lightbox="./media/process-data-azure-stream-analytics/query-editor.png":::
37
+
43
38
- The serialization type in your data is automatically detected (JSON/CSV). You can manually change it as well to JSON/CSV/AVRO.
44
39
- You can preview incoming data in the table format or raw format.
45
40
- If your data shown isn't current, select **Refresh** to see the latest events.
46
-
47
-
Here's an example of data in the **table format**:
48
-
49
-
:::image type="content" source="./media/process-data-azure-stream-analytics/snapshot-results.png" alt-text="Screenshot of the Input preview window in the result pane of the Process data page in a table format." lightbox="./media/process-data-azure-stream-analytics/snapshot-results.png":::
50
-
51
-
Here's an example of data in the **raw format**:
41
+
- In the preceding image, the results are shown in the table format. To see the raw data, select **Raw**
52
42
53
43
:::image type="content" source="./media/process-data-azure-stream-analytics/snapshot-results-raw-format.png" alt-text="Screenshot of the Input preview window in the result pane of the Process data page in the raw format." lightbox="./media/process-data-azure-stream-analytics/snapshot-results-raw-format.png":::
54
44
1. Select **Test query** to see the snapshot of test results of your query in the **Test results** tab. You can also download the results.
55
45
56
46
:::image type="content" source="./media/process-data-azure-stream-analytics/test-results.png" alt-text="Screenshot of the Input preview window in the result pane with test results." lightbox="./media/process-data-azure-stream-analytics/test-results.png":::
57
-
1. Write your own query to transform the data. See [Stream Analytics Query Language reference](/stream-analytics-query/stream-analytics-query-language-reference).
58
-
1. Once you've tested the query and you want to move it in to production, select **Create Stream Analytics job**.
47
+
48
+
Write your own query to transform the data. See [Stream Analytics Query Language reference](/stream-analytics-query/stream-analytics-query-language-reference).
49
+
1. Once you tested the query and you want to move it in to production, select **Create Stream Analytics job**.
59
50
60
51
:::image type="content" source="./media/process-data-azure-stream-analytics/create-job-link.png" alt-text="Screenshot of the Query page with the Create Stream Analytics job link selected.":::
61
52
1. On the **New Stream Analytics job** page, follow these steps:
@@ -103,5 +94,5 @@ Your Azure Stream Analytics job defaults to three streaming units (SUs). To adju
103
94
104
95
:::image type="content" source="./media/process-data-azure-stream-analytics/scale.png" alt-text="Screenshots showing the Scale page for a Stream Analytics job." lightbox="./media/process-data-azure-stream-analytics/scale.png":::
105
96
106
-
## Next steps
97
+
## Related content
107
98
To learn more about Stream Analytics queries, see [Stream Analytics Query Language](/stream-analytics-query/built-in-functions-azure-stream-analytics)
0 commit comments