Skip to content

Commit 3e3bf4c

Browse files
authored
Merge pull request #79271 from mamccrea/asa-fresh-11
Stream Analytics: freshness
2 parents a6fb765 + 398fc81 commit 3e3bf4c

15 files changed

+79
-95
lines changed
43.4 KB
Loading
-177 Bytes
Loading
-19.8 KB
Loading

articles/stream-analytics/stream-analytics-add-inputs.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,12 +4,12 @@ description: This article describe the concept of inputs in an Azure Stream Anal
44
services: stream-analytics
55
author: jseb225
66
ms.author: jeanb
7-
manager: kfile
87
ms.reviewer: jasonh
98
ms.service: stream-analytics
109
ms.topic: conceptual
11-
ms.date: 04/25/2018
10+
ms.date: 06/11/2019
1211
---
12+
1313
# Understand inputs for Azure Stream Analytics
1414

1515
Azure Stream Analytics jobs connect to one or more data inputs. Each input defines a connection to an existing data source. Stream Analytics accepts data incoming from several kinds of event sources including Event Hubs, IoT Hub, and Blob storage. The inputs are referenced by name in the streaming SQL query that you write for each job. In the query, you can join multiple inputs to blend data or compare streaming data with a lookup to reference data, and pass the results to outputs.

articles/stream-analytics/stream-analytics-get-started-with-azure-stream-analytics-to-process-data-from-iot-devices.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7,17 +7,19 @@ ms.author: mamccrea
77
ms.reviewer: jasonh
88
ms.service: stream-analytics
99
ms.topic: conceptual
10-
ms.date: 12/06/2018
11-
ms.custom: seodec18
10+
ms.date: 06/11/2019
1211
---
1312
# Get started with Azure Stream Analytics to process data from IoT devices
14-
In this tutorial, you will learn how to create stream-processing logic to gather data from Internet of Things (IoT) devices. We will use a real-world, Internet of Things (IoT) use case to demonstrate how to build your solution quickly and economically.
13+
14+
In this tutorial, you learn how to create stream-processing logic to gather data from Internet of Things (IoT) devices. We will use a real-world, Internet of Things (IoT) use case to demonstrate how to build your solution quickly and economically.
1515

1616
## Prerequisites
17+
1718
* [Azure subscription](https://azure.microsoft.com/pricing/free-trial/)
1819
* Sample query and data files downloadable from [GitHub](https://aka.ms/azure-stream-analytics-get-started-iot)
1920

2021
## Scenario
22+
2123
Contoso, which is a company in the industrial automation space, has completely automated its manufacturing process. The machinery in this plant has sensors that are capable of emitting streams of data in real time. In this scenario, a production floor manager wants to have real-time insights from the sensor data to look for patterns and take actions on them. We will use the Stream Analytics Query Language (SAQL) over the sensor data to find interesting patterns from the incoming stream of data.
2224

2325
Here data is being generated from a Texas Instruments sensor tag device. The payload of the data is in JSON format and looks like the following:

articles/stream-analytics/stream-analytics-power-bi-dashboard.md

Lines changed: 39 additions & 51 deletions
Original file line numberDiff line numberDiff line change
@@ -7,10 +7,10 @@ ms.author: jeanb
77
ms.reviewer: mamccrea
88
ms.service: stream-analytics
99
ms.topic: conceptual
10-
ms.date: 12/07/2018
11-
ms.custom: seodec18
10+
ms.date: 06/11/2019
1211
---
13-
# Tutorial: Stream Analytics and Power BI: A real-time analytics dashboard for streaming data
12+
# Stream Analytics and Power BI: A real-time analytics dashboard for streaming data
13+
1414
Azure Stream Analytics enables you to take advantage of one of the leading business intelligence tools, [Microsoft Power BI](https://powerbi.com/). In this article, you learn how create business intelligence tools by using Power BI as an output for your Azure Stream Analytics jobs. You also learn how to create and use a real-time dashboard.
1515

1616
This article continues from the Stream Analytics [real-time fraud detection](stream-analytics-real-time-fraud-detection.md) tutorial. It builds on the workflow created in that tutorial and adds a Power BI output so that you can visualize fraudulent phone calls that are detected by a Streaming Analytics job.
@@ -32,41 +32,31 @@ In the real-time fraud detection tutorial, the output is sent to Azure Blob stor
3232

3333
1. In the Azure portal, open the Streaming Analytics job that you created earlier. If you used the suggested name, the job is named `sa_frauddetection_job_demo`.
3434

35-
2. Select the **Outputs** box in the middle of the job dashboard and then select **+ Add**.
36-
37-
3. For **Output Alias**, enter `CallStream-PowerBI`. You can use a different name. If you do, make a note of it, because you need the name later.
38-
39-
4. Under **Sink**, select **Power BI**.
40-
41-
![Create an output for Power BI](./media/stream-analytics-power-bi-dashboard/create-power-bi-ouptut.png)
42-
43-
5. Click **Authorize**.
35+
2. On the left menu, select **Outputs** under **Job topology**. Then, select **+ Add** and choose **Power BI** from the dropdown menu.
4436

45-
A window opens where you can provide your Azure credentials for a work or school account.
37+
3. Select **+ Add** > **Power BI**. Then fill the form with the following details and select **Authorize**:
4638

47-
![Enter credentials for access to Power BI](./media/stream-analytics-power-bi-dashboard/power-bi-authorization-credentials.png)
39+
|**Setting** |**Suggested value** |
40+
|---------|---------|
41+
|Output alias | CallStream-PowerBI |
42+
|Dataset name | sa-dataset |
43+
|Table name | fraudulent-calls |
4844

49-
6. Enter your credentials. Be aware then when you enter your credentials, you're also giving permission to the Streaming Analytics job to access your Power BI area.
45+
![Configure Stream Analytics output](media/stream-analytics-power-bi-dashboard/configure-stream-analytics-output.png)
5046

51-
7. When you're returned to the **New output** blade, enter the following information:
47+
> [!WARNING]
48+
> If Power BI has a dataset and table that have the same names as the ones that you specify in the Stream Analytics job, the existing ones are overwritten.
49+
> We recommend that you do not explicitly create this dataset and table in your Power BI account. They are automatically created when you start your Stream Analytics job and the job starts pumping output into Power BI. If your job query doesn't return any results, the dataset and table are not created.
50+
>
5251
53-
* **Group Workspace**: Select a workspace in your Power BI tenant where you want to create the dataset.
54-
* **Dataset Name**: Enter `sa-dataset`. You can use a different name. If you do, make a note of it for later.
55-
* **Table Name**: Enter `fraudulent-calls`. Currently, Power BI output from Stream Analytics jobs can have only one table in a dataset.
56-
57-
![Power BI workspace dataset and table](./media/stream-analytics-power-bi-dashboard/create-pbi-ouptut-with-dataset-table.png)
58-
59-
> [!WARNING]
60-
> If Power BI has a dataset and table that have the same names as the ones that you specify in the Stream Analytics job, the existing ones are overwritten.
61-
> We recommend that you do not explicitly create this dataset and table in your Power BI account. They are automatically created when you start your Stream Analytics job and the job starts pumping output into Power BI. If your job query doesn't return any results, the dataset and table are not created.
62-
>
52+
4. When you select **Authorize**, a pop-up window opens and you are asked to provide credentials to authenticate to your Power BI account. Once the authorization is successful, **Save** the settings.
6353

6454
8. Click **Create**.
6555

6656
The dataset is created with the following settings:
6757

68-
* **defaultRetentionPolicy: BasicFIFO**: Data is FIFO, with a maximum of 200,000 rows.
69-
* **defaultMode: pushStreaming**: The dataset supports both streaming tiles and traditional report-based visuals (a.k.a. push).
58+
* **defaultRetentionPolicy: BasicFIFO** - Data is FIFO, with a maximum of 200,000 rows.
59+
* **defaultMode: pushStreaming** - The dataset supports both streaming tiles and traditional report-based visuals (also known as push).
7060

7161
Currently, you can't create datasets with other flags.
7262

@@ -84,54 +74,52 @@ For more information about Power BI datasets, see the [Power BI REST API](https:
8474
>[!NOTE]
8575
>If you did not name the input `CallStream` in the fraud-detection tutorial, substitute your name for `CallStream` in the **FROM** and **JOIN** clauses in the query.
8676
87-
```SQL
88-
/* Our criteria for fraud:
89-
Calls made from the same caller to two phone switches in different locations (for example, Australia and Europe) within five seconds */
77+
```SQL
78+
/* Our criteria for fraud:
79+
Calls made from the same caller to two phone switches in different locations (for example, Australia and Europe) within five seconds */
9080

91-
SELECT System.Timestamp AS WindowEnd, COUNT(*) AS FraudulentCalls
92-
INTO "CallStream-PowerBI"
93-
FROM "CallStream" CS1 TIMESTAMP BY CallRecTime
94-
JOIN "CallStream" CS2 TIMESTAMP BY CallRecTime
81+
SELECT System.Timestamp AS WindowEnd, COUNT(*) AS FraudulentCalls
82+
INTO "CallStream-PowerBI"
83+
FROM "CallStream" CS1 TIMESTAMP BY CallRecTime
84+
JOIN "CallStream" CS2 TIMESTAMP BY CallRecTime
9585

96-
/* Where the caller is the same, as indicated by IMSI (International Mobile Subscriber Identity) */
97-
ON CS1.CallingIMSI = CS2.CallingIMSI
86+
/* Where the caller is the same, as indicated by IMSI (International Mobile Subscriber Identity) */
87+
ON CS1.CallingIMSI = CS2.CallingIMSI
9888

99-
/* ...and date between CS1 and CS2 is between one and five seconds */
100-
AND DATEDIFF(ss, CS1, CS2) BETWEEN 1 AND 5
89+
/* ...and date between CS1 and CS2 is between one and five seconds */
90+
AND DATEDIFF(ss, CS1, CS2) BETWEEN 1 AND 5
10191

102-
/* Where the switch location is different */
103-
WHERE CS1.SwitchNum != CS2.SwitchNum
104-
GROUP BY TumblingWindow(Duration(second, 1))
105-
```
92+
/* Where the switch location is different */
93+
WHERE CS1.SwitchNum != CS2.SwitchNum
94+
GROUP BY TumblingWindow(Duration(second, 1))
95+
```
10696

10797
4. Click **Save**.
10898

10999

110100
## Test the query
101+
111102
This section is optional, but recommended.
112103

113104
1. If the TelcoStreaming app is not currently running, start it by following these steps:
114105

115-
* Open a command window.
106+
* Open Command Prompt.
116107
* Go to the folder where the telcogenerator.exe and modified telcodatagen.exe.config files are.
117108
* Run the following command:
118109

119110
`telcodatagen.exe 1000 .2 2`
120111

121-
2. In the **Query** blade, click the dots next to the `CallStream` input and then select **Sample data from input**.
112+
2. On the **Query** page for your Stream Analytics job, click the dots next to the `CallStream` input and then select **Sample data from input**.
122113

123114
3. Specify that you want three minutes' worth of data and click **OK**. Wait until you're notified that the data has been sampled.
124115

125-
4. Click **Test** and make sure you're getting results.
126-
116+
4. Click **Test** and review the results.
127117

128118
## Run the job
129119

130-
1. Make sure that the TelcoStreaming app is running.
131-
132-
2. Close the **Query** blade.
120+
1. Make sure the TelcoStreaming app is running.
133121

134-
3. In the job blade, click **Start**.
122+
2. Navigate to the **Overview** page for your Stream Analytics job and select **Start**.
135123

136124
![Start the Stream Analytics job](./media/stream-analytics-power-bi-dashboard/stream-analytics-sa-job-start-output.png)
137125

articles/stream-analytics/stream-analytics-quick-create-vs.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,10 @@ description: This quickstart shows you how to get started by creating a Stream A
44
services: stream-analytics
55
author: mamccrea
66
ms.author: mamccrea
7-
ms.date: 12/20/2018
7+
ms.date: 06/11/2019
88
ms.topic: quickstart
99
ms.service: stream-analytics
10-
ms.custom: mvc
10+
1111
#Customer intent: "As an IT admin/developer I want to create a Stream Analytics job, configure input and output & analyze data by using Visual Studio."
1212
---
1313

0 commit comments

Comments
 (0)