You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/stream-analytics/stream-analytics-define-inputs.md
+9Lines changed: 9 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,6 +32,12 @@ Stream Analytics also supports input known as *reference data*. This is auxiliar
32
32
33
33
To learn how to create reference data inputs, see [Use Reference Data](stream-analytics-use-reference-data.md).
34
34
35
+
## Compression
36
+
37
+
Azure Stream Analytics will soon be deploying a compression feature across all data stream input sources (Event Hubs, IoT Hub, and Blob storage). This feature adds a new dropdown option to the **New input** blade in Azure Portal, allowing you to optionally choose to compress data streams. Supported types are currently None, GZip, and Deflate compression.
38
+
39
+
Compression is not supported in tandem with Avro serialization, and is not applicable to reference data.
40
+
35
41
## Create data stream input from Event Hubs
36
42
37
43
Azure Event Hubs provides highly scalable publish-subscribe event ingestors. An event hub can collect millions of events per second, so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Event Hubs and Stream Analytics together provide you with an end-to-end solution for real-time analytics—Event Hubs let you feed events into Azure in real time, and Stream Analytics jobs can process those events in real time. For example, you can send web clicks, sensor readings, or online log events to Event Hubs. You can then create Stream Analytics jobs to use Event Hubs as the input data streams for real-time filtering, aggregating, and correlation.
@@ -53,6 +59,7 @@ The following table explains each property in the **New input** blade in the Azu
53
59
|**Event hub consumer group** (optional) |The consumer group to use to ingest data from the event hub. If no consumer group is specified, the Stream Analytics job uses the default consumer group. We recommend that you use a distinct consumer group for each Stream Analytics job. |
54
60
|**Event serialization format**|The serialization format (JSON, CSV, or Avro) of the incoming data stream. |
55
61
|**Encoding**| UTF-8 is currently the only supported encoding format. |
62
+
|**Compression** (optional) | The compression type (None, GZip, or Deflate) of the incoming data stream. |
56
63
57
64
When your data comes from an event hub, you have access to the following metadata fields in your Stream Analytics query:
58
65
@@ -98,6 +105,7 @@ The following table explains each property in the **New input** blade in the Azu
98
105
|**Consumer group** (optional) |The consumer group to use to ingest data from the IoT hub. If no consumer group is specified, a Stream Analytics job uses the default consumer group. We recommend that you use a different consumer group for each Stream Analytics job. |
99
106
|**Event serialization format**|The serialization format (JSON, CSV, or Avro) of the incoming data stream. |
100
107
|**Encoding**|UTF-8 is currently the only supported encoding format. |
108
+
|**Compression** (optional) | The compression type (None, GZip, or Deflate) of the incoming data stream. |
101
109
102
110
When your data comes from an IoT hub, you have access to the following metadata fields in your Stream Analytics query:
103
111
@@ -140,6 +148,7 @@ The following table explains each property in the **New input** blade in the Azu
140
148
|**Time format** (optional) | If you use the time variable in the path, the time format in which the files are organized. Currently the only supported value is `HH`. |
141
149
|**Event serialization format**| The serialization format (JSON, CSV, or Avro) for incoming data streams. |
142
150
|**Encoding**| For CSV and JSON, UTF-8 is currently the only supported encoding format. |
151
+
|**Compression** (optional) | The compression type (None, GZip, or Deflate) of the incoming data stream. |
143
152
144
153
When your data comes from a Blob storage source, you have access to the following metadata fields in your Stream Analytics query:
0 commit comments