You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/iot-operations/connect-to-cloud/concept-schema-registry.md
+7-5Lines changed: 7 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,11 +13,11 @@ ms.date: 09/23/2024
13
13
14
14
Schema registry, a feature provided by Azure Device Registry Preview, is a synchronized repository in the cloud and at the edge. The schema registry stores the definitions of messages coming from edge assets, and then exposes an API to access those schemas at the edge.
15
15
16
-
The connector for OPC UA can create message schemas and add them to the schema registry or customers can upload schemas to the operations experience web UI.
16
+
The connector for OPC UA can create message schemas and add them to the schema registry or customers can upload schemas to the operations experience web UI or using ARM/Bicep templates.
17
17
18
18
Edge services use message schemas to filter and transform messages as they're routed across your industrial edge scenario.
19
19
20
-
*Schemas* are documents that describe data to enable processing and contextualization. *Message schemas* describe the format of a message and its contents.
20
+
*Schemas* are documents that describe the format of a message and its contents to enable processing and contextualization.
21
21
22
22
## Message schema definitions
23
23
@@ -87,11 +87,11 @@ Message schemas are used in all three phases of a dataflow: defining the source
87
87
88
88
### Input schema
89
89
90
-
Each dataflow source requires a message schema.
90
+
Each dataflow source can optionally specify a message schema. If a schema is defined for a dataflow source, any incoming messages that don't match the schema are dropped.
91
91
92
92
Asset sources have a predefined message schema that was created by the connector for OPC UA.
93
93
94
-
MQTT sources require an uploaded message schema. Currently, Azure IoT Operations supports JSON for input schemas. In the operations experience, you can select an existing schema or upload one while defining an MQTT source:
94
+
Schemas can be uploaded for MQTT sources. Currently, Azure IoT Operations supports JSON for source schemas, also known as input schemas. In the operations experience, you can select an existing schema or upload one while defining an MQTT source:
95
95
96
96
:::image type="content" source="./media/concept-schema-registry/upload-schema.png" alt-text="Screenshot that shows uploading a message schema in the operations experience portal.":::
97
97
@@ -101,6 +101,8 @@ The operations experience uses the input schema as a starting point for your dat
101
101
102
102
### Output schema
103
103
104
-
Schemas are only used for dataflows that select local storage, Fabric, Azure Data Lake, or Azure Data Explorer as the destination endpoint. Currently, Azure IoT Operations supports Delta Parquey for outpus schema.
104
+
Output schemas are associated with dataflow destinations are only used for dataflows that select local storage, Fabric, Azure Storage (ADLS Gen2), or Azure Data Explorer as the destination endpoint. Currently, Azure IoT Operations experience only supports Parquet output for output schemas.
105
+
106
+
Note: The Delta schema format is used for both Parquet and Delta output.
105
107
106
108
For these dataflows, the operations experience applies any transformations to the input schema then creates a new schema in Delta format. When the dataflow custom resource (CR) is created, it includes a `schemaRef` value that points to the generated schema stored in the schema registry.
0 commit comments