Skip to content

Commit e879c3f

Browse files
authored
Merge pull request #234358 from dominicbetts/iot-overviews-pt2
IoT: overview articles
2 parents d29250f + 7085bb7 commit e879c3f

File tree

11 files changed

+6006
-8
lines changed

11 files changed

+6006
-8
lines changed

articles/iot/iot-introduction.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ The Azure Internet of Things (IoT) is a collection of Microsoft-managed cloud se
1717

1818
The following diagram shows a high-level view of the components in a typical IoT solution. This article focuses on the key groups of components: devices, IoT cloud services, other cloud services, and solution-wide concerns. Other articles in this section provide more detail on each of these components.
1919

20-
:::image type="content" source="media/iot-introduction/iot-architecture.svg" lightbox="media/iot-introduction/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture." border="false":::
20+
:::image type="content" source="media/iot-introduction/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture." border="false":::
2121

2222
## IoT devices
2323

Lines changed: 85 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,85 @@
1+
---
2+
title: Analyze and visualize your IoT data
3+
description: An overview of the available options to analyze and visualize data in an IoT solution.
4+
ms.service: iot
5+
services: iot
6+
author: dominicbetts
7+
ms.author: dobett
8+
ms.topic: overview
9+
ms.date: 04/11/2023
10+
ms.custom: template-overview
11+
12+
# As a solution builder, I want a high-level overview of the options for analyzing and visualizing device data in an IoT solution.
13+
---
14+
15+
# Analyze and visualize your IoT data
16+
17+
This overview introduces the key concepts around the options to analyze and visualize your IoT data. Each section includes links to content that provides further detail and guidance.
18+
19+
The following diagram shows a high-level view of the components in a typical IoT solution. This article focuses on the areas relevant to analyzing and visualizing your IoT data.
20+
21+
:::image type="content" source="media/iot-overview-analyze-visualize/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting analysis and visualization areas." border="false":::
22+
23+
In Azure IoT, analysis and visualization services are used to identify and display business insights derived from your IoT data. For example, you can use a machine learning model to analyze device telemetry and predict when maintenance should be carried out on an industrial asset. You can also use a visualization tool to display a map of the location of your devices.
24+
25+
## Azure Digital Twins
26+
27+
The Azure Digital Twins service lets you build and maintain models that are live, up-to-date representations of the real world. You can query, analyze, and generate visualizations from these models to extract business insights. An example model might be a representation of a building that includes information about the rooms, the devices in the rooms, and the relationships between the rooms and devices. The real-world data that populates these models is typically collected from IoT devices and sent through an IoT hub.
28+
29+
## External services
30+
31+
There are many services you can use to analyze and visualize your IoT data. Some services are designed to work with streaming IoT data, while others are more general-purpose. The following services are some of the most common ones used for analysis and visualization in IoT solutions:
32+
33+
### Azure Data Explorer
34+
35+
[Azure Data Explorer](/azure/data-explorer/data-explorer-overview/) is a fully managed, high-performance, big-data analytics platform that makes it easy to analyze high volumes of data in near real time. The following articles and tutorials show some examples of how to use Azure Data Explorer to analyze and visualize IoT data:
36+
37+
- [IoT Hub data connection (Azure Data Explorer)](/azure/data-explorer/ingest-data-iot-hub-overview)
38+
- [Explore an Azure IoT Central industrial scenario](../iot-central/core/tutorial-industrial-end-to-end.md)
39+
- [Export IoT data to Azure Data Explorer (IoT Central)](../iot-central/core/howto-export-to-azure-data-explorer.md)
40+
- [Azure Digital Twins query plugin for Azure Data Explorer](../digital-twins/concepts-data-explorer-plugin.md)
41+
42+
### Databricks
43+
44+
Use [Azure Databricks](/azure/databricks/introduction/) to process, store, clean, share, analyze, model, and monetize datasets with solutions from BI to machine learning. Use the Azure Databricks platform to build and deploy data engineering workflows, machine learning models, analytics dashboards, and more.
45+
46+
- [Use structured streaming with Azure Event Hubs and Azure Databricks clusters](/azure/databricks/structured-streaming/streaming-event-hubs/). You can connect a Databricks workspace to the Event Hubs-compatible endpoint on an IoT hub to read data from IoT devices.
47+
- [Extend Azure IoT Central with custom analytics](../iot-central/core/howto-create-custom-analytics.md)
48+
49+
### Azure Stream Analytics
50+
51+
Azure Stream Analytics is a fully managed stream processing engine that is designed to analyze and process large volumes of streaming data with low latency. Patterns and relationships can be identified in data that originates from various input sources including applications, devices, and sensors. You can use these patterns to trigger actions and initiate workflows such as creating alerts or feeding information to a reporting tool. Stream Analytics is also available on the Azure IoT Edge runtime, enabling data processing directly on the edge.
52+
53+
- [Build an IoT solution by using Stream Analytics](../stream-analytics/stream-analytics-build-an-iot-solution-using-stream-analytics.md)
54+
- [Real-time data visualization of data from Azure IoT Hub](../iot-hub/iot-hub-live-data-visualization-in-power-bi.md)
55+
- [Extend Azure IoT Central with custom rules and notifications](../iot-central/core/howto-create-custom-rules.md)
56+
- [Deploy Azure Stream Analytics as an IoT Edge module](../iot-edge/tutorial-deploy-stream-analytics.md)
57+
58+
### Power BI
59+
60+
[Power BI](/power-bi/fundamentals/power-bi-overview) is a collection of software services, apps, and connectors that work together to turn your unrelated sources of data into coherent, visually immersive, and interactive insights. Power BI lets you easily connect to your data sources, visualize and discover what's important, and share that with anyone or everyone you want.
61+
62+
- [Visualize real-time sensor data from Azure IoT Hub using Power BI](../iot-hub/iot-hub-live-data-visualization-in-power-bi.md)
63+
- [Export data from Azure IoT Central and visualize insights in Power BI](../iot-central/retail/tutorial-in-store-analytics-export-data-visualize-insights.md)
64+
65+
### Azure Maps
66+
67+
[Azure Maps](../azure-maps/about-azure-maps.md) is a collection of geospatial services and SDKs that use fresh mapping data to provide geographic context to web and mobile applications. For an IoT example, see [Integrate with Azure Maps (Azure Digital Twins)](../digital-twins/how-to-integrate-maps.md)
68+
69+
### Grafana
70+
71+
[Grafana](https://grafana.com/) is visualization and analytics software. It allows you to query, visualize, alert on, and explore your metrics, logs, and traces no matter where they're stored. It provides you with tools to turn your time-series database data into insightful graphs and visualizations. [Azure Managed Grafana](https://azure.microsoft.com/products/managed-grafana) is a fully managed service for analytics and monitoring solutions. To learn more about using Grafana in your IoT solution, see [Cloud IoT dashboards using Grafana with Azure IoT](https://sandervandevelde.wordpress.com/2021/06/15/cloud-iot-dashboards-using-grafana-with-azure-iot/).
72+
73+
## IoT Central
74+
75+
IoT Central provides a rich set of features that you can use to analyze and visualize your IoT data. The following articles and tutorials show some examples of how to use IoT Central to analyze and visualize IoT data:
76+
77+
- [How to use IoT Central data explorer to analyze device data](../iot-central/core/howto-create-analytics.md)
78+
- [Create and manage IoT Central dashboards](../iot-central/core/howto-manage-dashboards.md)
79+
80+
## Next steps
81+
82+
Now that you've seen an overview of the analysis and visualization options available to your IoT solution, some suggested next steps include:
83+
84+
- [Choose the right IoT solution](iot-solution-options.md)
85+
- [Azure IoT services and technologies](iot-services-and-technologies.md)

articles/iot/iot-overview-device-connectivity.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ IoT Central applications use the IoT Hub and the Device Provisioning Service (DP
2020

2121
The following diagram shows a high-level view of the components in a typical IoT solution. This article focuses on the connectivity between the devices and the IoT cloud services, including gateways and bridges, shown in the diagram.
2222

23-
:::image type="content" source="media/iot-overview-device-connectivity/iot-architecture.svg" lightbox="media/iot-overview-device-connectivity/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting device connectivity areas." border="false":::
23+
:::image type="content" source="media/iot-overview-device-connectivity/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting device connectivity areas." border="false":::
2424

2525
## Primitives
2626

@@ -133,5 +133,5 @@ The open source IoT Central Device Bridge acts as a translator that forwards tel
133133

134134
Now that you've seen an overview of device connectivity in Azure IoT solutions, some suggested next steps include
135135

136-
- [IoT device development](iot-overview-device-development.md)
137136
- [Device management and control in IoT solutions](iot-overview-device-management.md)
137+
- [Process and route messages](iot-overview-message-processing.md)

articles/iot/iot-overview-device-development.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ This overview introduces the key concepts around developing devices that connect
1818

1919
The following diagram shows a high-level view of the components in a typical IoT solution. This article focuses on the devices and gateway shown in the diagram.
2020

21-
:::image type="content" source="media/iot-overview-device-development/iot-architecture.svg" lightbox="media/iot-overview-device-development/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting device connectivity areas." border="false":::
21+
:::image type="content" source="media/iot-overview-device-development/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting device connectivity areas." border="false":::
2222

2323
In Azure IoT, a device developer writes the code to run on the devices in the solution. This code typically:
2424

articles/iot/iot-overview-device-management.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ IoT Central applications use the IoT Hub and the Device Provisioning Service (DP
2020

2121
The following diagram shows a high-level view of the components in a typical IoT solution. This article focuses on the device management and control components of an IoT solution.
2222

23-
:::image type="content" source="media/iot-overview-device-management/iot-architecture.svg" lightbox="media/iot-overview-device-management/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting device connectivity areas." border="false":::
23+
:::image type="content" source="media/iot-overview-device-management/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting device connectivity areas." border="false":::
2424

2525
In Azure IoT, device management refers to processes such as provisioning and updating devices. Device management includes the following tasks:
2626

@@ -139,5 +139,5 @@ To learn more, see:
139139

140140
Now that you've seen an overview of device management and control in Azure IoT solutions, some suggested next steps include
141141

142-
- [IoT device development](iot-overview-device-development.md)
143-
- [Device infrastructure and connectivity](iot-overview-device-connectivity.md)
142+
- [Process and route messages](iot-overview-message-processing.md)
143+
- [Extend your IoT solution](iot-overview-solution-extensibility.md)
Lines changed: 113 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,113 @@
1+
---
2+
title: Process messages from your devices
3+
description: An overview of message processing options in an Azure IoT solution including routing and enrichments.
4+
ms.service: iot
5+
services: iot
6+
author: dominicbetts
7+
ms.author: dobett
8+
ms.topic: overview
9+
ms.date: 04/03/2023
10+
ms.custom: template-overview
11+
12+
# As a solution builder or device developer I want a high-level overview of the message processing in IoT solutions so that I can easily find relevant content for my scenario.
13+
---
14+
15+
# Message processing in an IoT solution
16+
17+
This overview introduces the key concepts around processing messages sent from your devices in a typical Azure IoT solution. Each section includes links to content that provides further detail and guidance.
18+
19+
The following diagram shows a high-level view of the components in a typical IoT solution. This article focuses on the message processing components of an IoT solution.
20+
21+
:::image type="content" source="media/iot-overview-message-processing/iot-architecture.svg" alt-text="Diagram that shows the high-level IoT solution architecture highlighting message processing areas." border="false":::
22+
23+
In Azure IoT, message processing refers to processes such as routing and enriching telemetry messages sent by devices. These processes are used to control the flow of messages through the IoT solution and to add additional information to the messages.
24+
25+
## Route messages
26+
27+
An IoT hub provides a cloud entry point for the telemetry messages that your devices send. In a typical IoT solution, these messages are delivered to other downstream services for storage or analysis.
28+
29+
### IoT Hub routing
30+
31+
In IoT hub, you can configure routing to deliver telemetry messages to the destinations of your choice. Destinations include:
32+
33+
- Storage containers
34+
- Service Bus queues
35+
- Service Bus topics
36+
- Event Hubs
37+
38+
Every IoT hub has a default destination called the *built-in* endpoint. Downstream services can [connect to the built-in endpoint to receive messages](../iot-hub/iot-hub-devguide-messages-read-builtin.md) from the IoT hub.
39+
40+
To learn more, see [Use IoT Hub message routing to send device-to-cloud messages to different endpoints](../iot-hub/iot-hub-devguide-messages-d2c.md).
41+
42+
You can use [queries to filter the messages](../iot-hub/iot-hub-devguide-routing-query-syntax.md) sent to different destinations.
43+
44+
## IoT Central routing
45+
46+
If you're using IoT Central, you can use data export to send telemetry messages to other downstream services. Destinations include:
47+
48+
- Storage containers
49+
- Service Bus queues
50+
- Service Bus topics
51+
- Event Hubs
52+
- Azure Data Explorer
53+
- Webhooks
54+
55+
An IoT Central data export configuration lets you filter the messages sent to a destination.
56+
57+
To learn more, see [Export data from IoT Central](../iot-central/core/howto-export-to-blob-storage.md).
58+
59+
### Event Grid
60+
61+
IoT Hub has built-in integration with [Azure Event Grid](../event-grid/overview.md). An IoT hub can publish an event whenever it receives a telemetry message from a device. You can use Event Grid to route these events to other services.
62+
63+
To learn more, see [React to IoT Hub events by using Event Grid to trigger actions](../iot-hub/iot-hub-event-grid.md) and [Compare message routing and Event Grid for IoT Hub](../iot-hub/iot-hub-event-grid-routing-comparison.md).
64+
65+
## Enrich or transform messages
66+
67+
To simplify downstream processing, you may want to add data to telemetry messages or modify their structure.
68+
69+
### IoT Hub message enrichments
70+
71+
IoT Hub message enrichments let you add data to the messages sent by your devices. You can add:
72+
73+
- A static string
74+
- The name of the IoT hub processing the message
75+
- Information from the device twin
76+
77+
To learn more, see [Message enrichments for device-to-cloud IoT Hub messages](../iot-hub/iot-hub-message-enrichments-overview.md).
78+
79+
### IoT Central message transformations
80+
81+
IoT Central has two options for transforming telemetry messages:
82+
83+
- Use [mappings](../iot-central/core/howto-map-data.md) to transform complex device telemetry into structured data on ingress to IoT Central.
84+
- Use [transformations](../iot-central/core/howto-transform-data-internally.md) to manipulate the format and structure of the device data before it's exported to a destination.
85+
86+
## Process messages at the edge
87+
88+
An Azure IoT Edge module can process telemetry from an attached sensor or device before it's sent to an IoT hub. For example, before it sends data to the cloud an IoT Edge module can:
89+
90+
- [Filter data](../iot-edge/tutorial-deploy-function.md)
91+
- Aggregate data
92+
- [Convert data](../iot-central/core/howto-transform-data.md#data-transformation-at-ingress)
93+
94+
## Other cloud services
95+
96+
You can use other Azure services to process telemetry messages from your devices. Both IoT Hub and IoT Central can route messages to other services. For example, you can forward telemetry messages to:
97+
98+
[Azure Stream Analytics](../stream-analytics/stream-analytics-introduction.md) is a managed stream processing engine that is designed to analyze and process large volumes of streaming data. Stream Analytics can identify patterns in your data and then trigger actions such as creating alerts, feeding information to a reporting tool, or storing the transformed data. Stream Analytics is also available on the Azure IoT Edge runtime, enabling it to process data at the edge rather than in the cloud.
99+
100+
[Azure Functions](../azure-functions/functions-overview.md) is a serverless compute service that lets you run code in response to events. You can use Azure Functions to process telemetry messages from your devices.
101+
102+
To learn more, see:
103+
104+
- [Azure IoT Hub bindings for Azure Functions](../azure-functions/functions-bindings-event-iot.md)
105+
- [Visualize real-time sensor data from Azure IoT Hub using Power BI](../iot-hub/iot-hub-live-data-visualization-in-power-bi.md)
106+
- [Extend Azure IoT Central with custom rules using Stream Analytics, Azure Functions, and SendGrid](../iot-central/core/howto-create-custom-rules.md)
107+
108+
## Next steps
109+
110+
Now that you've seen an overview of device management and control in Azure IoT solutions, some suggested next steps include
111+
112+
- [Extend your IoT solution](iot-overview-solution-extensibility.md)
113+
- [Analyze and visualize your IoT data](iot-overview-analyze-visualize.md)

0 commit comments

Comments
 (0)