You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/iot-central/core/concepts-architecture-pnp.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -77,7 +77,7 @@ An application can have one or more simulated and real devices based on each dev
77
77
78
78
## Data export
79
79
80
-
In an Azure IoT Central application, you can [continuously export your data](howto-export-data-pnp.md?toc=/azure/iot-central-pnp/toc.json&bc=/azure/iot-central-pnp/breadcrumb/toc.json) to your own Azure Event Hubs and Azure Service Bus instances. You can also periodically export your data to your Azure Blob storage account. IoT Central can export measurements, devices, and device templates.
80
+
In an Azure IoT Central application, you can [continuously export your data](howto-export-data-pnp.md?toc=/azure/iot-central-pnp/toc.json&bc=/azure/iot-central-pnp/breadcrumb/toc.json) to your own Azure Event Hubs, Azure Service Bus, and Azure Blob Storage instances. IoT Central can export telemetry, devices, and device templates.
Copy file name to clipboardExpand all lines: articles/iot-central/core/concepts-architecture.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -78,7 +78,7 @@ An application can have one or more simulated and real devices based on each dev
78
78
79
79
## Data export
80
80
81
-
In an Azure IoT Central application, you can [continuously export your data](howto-export-data-event-hubs-service-bus.md) to your own Azure Event Hubs, and Azure Service Bus instances. You can also periodically export your data to your Azure Blob storage account. IoT Central can export measurements, devices, and device templates.
81
+
In an Azure IoT Central application, you can [continuously export your data](howto-export-data-event-hubs-service-bus.md) to your own Azure Event Hubs, Azure Service Bus, and Azure Blob Storage instances. IoT Central can export measurements, devices, and device templates.
This article describes how to use the continuous data export feature in Azure IoT Central to export your data to Azure Event Hubs, Azure Service Bus, or Azure Blob storage instances. Data is exported in JSON format and can include telemetry, device information, and device template information. Use the exported data for:
19
+
This article describes how to use the continuous data export feature in Azure IoT Central to export your data to **Azure Event Hubs**, **Azure Service Bus**, or **Azure Blob storage** instances. Data is exported in JSON format and can include telemetry, device information, and device template information. Use the exported data for:
20
20
21
21
- Warm-path insights and analytics. This option includes triggering custom rules in Azure Stream Analytics, triggering custom workflows in Azure Logic Apps, or passing it through Azure Functions to be transformed.
22
22
- Cold-path analytics such as training models in Azure Machine Learning or long-term trend analysis in Microsoft Power BI.
@@ -103,30 +103,33 @@ Now that you have a destination to export data to, follow these steps to set up
103
103
104
104
9. After a few minutes, your data appears in your chosen destination.
105
105
106
-
## Data format
106
+
## Export contents and format
107
107
108
-
Data is exported to your event hub or Service Bus queue or topic in near-realtime.
108
+
Exported telemetry data contains the entirety of the message your devices sent to IoT Central, not just the telemetry values themselves. Exported devices data contains changes to properties and metadata of all devices, and exported device templates contains changes to all device templates.
109
109
110
-
Data is exported to your storage account once per minute, with each file containing the batch of changes since the last exported file. Exported data is placed in three folders in JSON format. The default paths in your storage account are:
110
+
For Event Hubs and Service Bus, data is exported in near-realtime. The data sits in the body property and is in JSON format (see below for examples).
111
+
112
+
For Blob Storage, data is exported once per minute, with each file containing the batch of changes since the last exported file. Exported data is placed in three folders in JSON format. The default paths in your storage account are:
You can browse the exported files in the Azure portal by navigating to the file and choosing the **Edit blob** tab.
117
119
118
-
Exported telemetry data contains the entirety of the message your devices sent to IoT Central, not just the telemetry values themselves. Exported devices data contains changes to properties and metadata of all devices, and exported device templates contains changes to all device templates. The exported data is in the body property and is in JSON format.
119
120
120
-
### Telemetry
121
+
## Telemetry
122
+
123
+
For Event Hubs and Service Bus, a new message is exported quickly after IoT Central receives the message from a device, and each exported message contains the full message the device sent in the body property in JSON format.
121
124
122
-
A new message is exported quickly after IoT Central receives the message from a device.
125
+
For Blob Storage, messages are batched and exported once per minute. The exported files use the same format as the message files exported by [IoT Hub message routing](../../iot-hub/iot-hub-csharp-csharp-process-d2c.md) to blob storage.
123
126
124
-
- Each exported message in Event Hubs and Service Bus contains the full message the device sent in the body property in JSON format.
125
-
- The exported files in blob storage use the same format as the message files exported by [IoT Hub message routing](../../iot-hub/iot-hub-csharp-csharp-process-d2c.md) to blob storage. Ensure that your devices are sending messages that have `contentType: application/JSON` and `contentEncoding:utf-8` (or `utf-16`, `utf-32`). See the [IoT Hub documentation](../../iot-hub/iot-hub-devguide-routing-query-syntax.md#message-routing-query-based-on-message-body) for an example.
127
+
> [!NOTE]
128
+
> For Blob Storage, ensure that your devices are sending messages that have `contentType: application/JSON` and `contentEncoding:utf-8` (or `utf-16`, `utf-32`). See the [IoT Hub documentation](../../iot-hub/iot-hub-devguide-routing-query-syntax.md#message-routing-query-based-on-message-body) for an example.
126
129
127
-
The devices that send the telemetry are represented by device IDs (see the following sections). To get the names of the devices, export device data and correlate each message by using the **connectionDeviceId** that matches the **deviceId** of the device message.
130
+
The device that sent the telemetry is represented by the device ID (see the following sections). To get the names of the devices, export device data and correlate each message by using the **connectionDeviceId** that matches the **deviceId** of the device message.
128
131
129
-
The following example shows a message about telemetry data received in event hub or Service Bus queue or topic.
132
+
This is an example message received in an event hub or Service Bus queue or topic.
130
133
131
134
```json
132
135
{
@@ -155,7 +158,7 @@ The following example shows a message about telemetry data received in event hub
155
158
}
156
159
```
157
160
158
-
The following example shows a record in JSON format in blob storage:
161
+
This is an example record exported to blob storage:
159
162
160
163
```json
161
164
{
@@ -179,26 +182,25 @@ The following example shows a record in JSON format in blob storage:
179
182
}
180
183
```
181
184
182
-
### Devices
183
-
184
-
Messages containing device data are sent to your event hub or Service Bus queue or topic once every few minutes. A new snapshot is written to blob storage once per minute. Each message or snapshot includes data about:
185
+
## Devices
185
186
186
-
- New devices that were added
187
-
- Devices with changed property values
188
-
189
-
Each message or record in a snapshot represents one or more changes to a device since the last exported message. Information includes:
187
+
Each message or record in a snapshot represents one or more changes to a device and its properties since the last exported message. This includes:
190
188
191
189
-`@id` of the device in IoT Central
192
190
-`name` of the device
193
-
-`deviceId` from [Device Provisioning Service](/azure/iot-central/core/howto-connect-nodejs)
194
-
-Device template information
191
+
-`deviceId`which matches the `connectionDeviceId`from the telemetry stream above
192
+
-`instanceOf` which is the device template Id
195
193
- Property values
196
194
197
-
Devices deleted since the last batch aren't exported. Currently, there are no indicators in exported messages for deleted devices.
195
+
The device template that each device belongs to is represented by the `instanceOf`. To get the name and additional information about the device template, be sure to export device template data too.
196
+
197
+
Deleted devices aren't exported. Currently, there are no indicators in exported messages for deleted devices.
198
+
199
+
For Event Hubs and Service Bus, messages containing device data are sent to your event hub or Service Bus queue or topic in near real-time, as it appears in IoT Central.
198
200
199
-
The device template that each device belongs to is represented by a device template ID. To get the name of the device template, be sure to export device template data too.
201
+
For Blob Storage, a new snapshot containing all the changes since the last one written is exported once per minute.
200
202
201
-
The following example shows a message about device data in event hub or Service Bus queue or topic:
203
+
This is an example message about devices and properties data in event hub or Service Bus queue or topic:
202
204
203
205
```json
204
206
{
@@ -257,7 +259,7 @@ The following example shows a message about device data in event hub or Service
257
259
}
258
260
```
259
261
260
-
Exported files contain a single line per record. The following example shows a record in JSON format.
262
+
This is an example snapshot containing devices and properties data in Blob Storage. Exported files contain a single line per record.
261
263
262
264
```json
263
265
{
@@ -303,27 +305,24 @@ Exported files contain a single line per record. The following example shows a r
303
305
}
304
306
```
305
307
306
-
### Device templates
307
-
308
-
Messages containing device templates data are sent to your event hub or Service Bus queue or topic once every few minutes. A new snapshot is written once per minute to blob storage. Therefore, every few minutes, a batch of messages arrives with data about:
309
-
310
-
Messages containing device template data are sent to your event hub or Service Bus queue or topic once every few minutes. A new snapshot is written to blob storage once per minute. Each message or snapshot includes data about:
311
-
312
-
- New device templates that were added or versioned
313
-
- Device templates with changed capability models, cloud properties, overrides, and initial values
308
+
## Device templates
314
309
315
310
Each message or snapshot record represents one or more changes to a device template since the last exported message. Information sent in each message or record includes:
316
311
317
-
-`@id` of the device template
312
+
-`@id` of the device template which matches the `instanceOf` of the devices stream above
318
313
-`name` of the device template
319
314
-`version` of the device template
320
315
- The device `capabilityModel` including its `interfaces`, and the telemetry, properties, and commands definitions
321
316
-`cloudProperties` definitions
322
317
- Overrides and initial values, inline with the `capabilityModel`
323
318
324
-
Device templates deleted since the last batch aren't exported. Currently, there are no indicators in exported messages for deleted device templates.
319
+
Deleted device templates aren't exported. Currently, there are no indicators in exported messages for deleted device templates.
320
+
321
+
For Event Hubs and Service Bus, messages containing device template data are sent to your event hub or Service Bus queue or topic in near real-time, as it appears in IoT Central.
322
+
323
+
For Blob Storage, a new snapshot containing all the changes since the last one written is exported once per minute.
325
324
326
-
The following example shows a device template message in event hub or Service Bus queue or topic:
325
+
This is an example message about device templates data in event hub or Service Bus queue or topic:
327
326
328
327
```json
329
328
{
@@ -470,7 +469,7 @@ The following example shows a device template message in event hub or Service Bu
470
469
}
471
470
```
472
471
473
-
Exported files contain a single line per record. The following example shows a record in JSON format.
472
+
This is an example snapshot containing devices and properties data in Blob Storage. Exported files contain a single line per record.
474
473
475
474
```json
476
475
{
@@ -606,7 +605,7 @@ Exported files contain a single line per record. The following example shows a r
606
605
607
606
## Next steps
608
607
609
-
Now that you know how to export your data to Azure Event Hubs and Azure Service Bus, continue to the next step:
608
+
Now that you know how to export your data to Azure Event Hubs, Azure Service Bus, and Azure Blob Storage, continue to the next step:
610
609
611
610
> [!div class="nextstepaction"]
612
611
> [How to trigger Azure Functions](howto-trigger-azure-functions.md?toc=/azure/iot-central-pnp/toc.json&bc=/azure/iot-central-pnp/breadcrumb/toc.json)
Copy file name to clipboardExpand all lines: articles/iot-central/core/tutorial-create-telemetry-rules-pnp.md
+1-5Lines changed: 1 addition & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -104,10 +104,6 @@ Choose the rule you want to enable or disable. Add a filter in the **Scopes** se
104
104
105
105
## Next steps
106
106
107
-
Now that you have learned how to create rules in your Azure IoT Central application, the suggested next step is to learn [How to manage your devices](howto-manage-devices-pnp.md?toc=/azure/iot-central-pnp/toc.json&bc=/azure/iot-central-pnp/breadcrumb/toc.json)
108
-
109
-
## Next steps
110
-
111
107
In this tutorial, you learned how to:
112
108
113
109
* Create a telemetry-based rule
@@ -116,4 +112,4 @@ In this tutorial, you learned how to:
116
112
Now that you've defined a threshold-based rule the suggested next step is to learn how to:
117
113
118
114
> [!div class="nextstepaction"]
119
-
> [Configure continuous data export](./howto-export-data-pnp.md?toc=/azure/iot-central-pnp/toc.json&bc=/azure/iot-central-pnp/breadcrumb/toc.json).
115
+
> [Create a webhook action](./howto-create-webhooks-pnp.md?toc=/azure/iot-central-pnp/toc.json&bc=/azure/iot-central-pnp/breadcrumb/toc.json).
0 commit comments