Skip to content

Commit 9a923e6

Browse files
authored
Merge pull request #2713 from CourtneyThurston/master
Documentation for compression feature
2 parents d45f596 + e3b5dd0 commit 9a923e6

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

articles/stream-analytics/stream-analytics-define-inputs.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,12 @@ Stream Analytics also supports input known as *reference data*. This is auxiliar
3232

3333
To learn how to create reference data inputs, see [Use Reference Data](stream-analytics-use-reference-data.md).
3434

35+
## Compression
36+
37+
Azure Stream Analytics will soon be deploying a compression feature across all data stream input sources (Event Hubs, IoT Hub, and Blob storage). This feature adds a new dropdown option to the **New input** blade in Azure Portal, allowing you to optionally choose to compress data streams. Supported types are currently None, GZip, and Deflate compression.
38+
39+
Compression is not supported in tandem with Avro serialization, and is not applicable to reference data.
40+
3541
## Create data stream input from Event Hubs
3642

3743
Azure Event Hubs provides highly scalable publish-subscribe event ingestors. An event hub can collect millions of events per second, so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Event Hubs and Stream Analytics together provide you with an end-to-end solution for real-time analytics—Event Hubs let you feed events into Azure in real time, and Stream Analytics jobs can process those events in real time. For example, you can send web clicks, sensor readings, or online log events to Event Hubs. You can then create Stream Analytics jobs to use Event Hubs as the input data streams for real-time filtering, aggregating, and correlation.
@@ -53,6 +59,7 @@ The following table explains each property in the **New input** blade in the Azu
5359
| **Event hub consumer group** (optional) |The consumer group to use to ingest data from the event hub. If no consumer group is specified, the Stream Analytics job uses the default consumer group. We recommend that you use a distinct consumer group for each Stream Analytics job. |
5460
| **Event serialization format** |The serialization format (JSON, CSV, or Avro) of the incoming data stream. |
5561
| **Encoding** | UTF-8 is currently the only supported encoding format. |
62+
| **Compression** (optional) | The compression type (None, GZip, or Deflate) of the incoming data stream. |
5663

5764
When your data comes from an event hub, you have access to the following metadata fields in your Stream Analytics query:
5865

@@ -98,6 +105,7 @@ The following table explains each property in the **New input** blade in the Azu
98105
| **Consumer group** (optional) |The consumer group to use to ingest data from the IoT hub. If no consumer group is specified, a Stream Analytics job uses the default consumer group. We recommend that you use a different consumer group for each Stream Analytics job. |
99106
| **Event serialization format** |The serialization format (JSON, CSV, or Avro) of the incoming data stream. |
100107
| **Encoding** |UTF-8 is currently the only supported encoding format. |
108+
| **Compression** (optional) | The compression type (None, GZip, or Deflate) of the incoming data stream. |
101109

102110
When your data comes from an IoT hub, you have access to the following metadata fields in your Stream Analytics query:
103111

@@ -140,6 +148,7 @@ The following table explains each property in the **New input** blade in the Azu
140148
| **Time format** (optional) | If you use the time variable in the path, the time format in which the files are organized. Currently the only supported value is `HH`. |
141149
| **Event serialization format** | The serialization format (JSON, CSV, or Avro) for incoming data streams. |
142150
| **Encoding** | For CSV and JSON, UTF-8 is currently the only supported encoding format. |
151+
| **Compression** (optional) | The compression type (None, GZip, or Deflate) of the incoming data stream. |
143152

144153
When your data comes from a Blob storage source, you have access to the following metadata fields in your Stream Analytics query:
145154

0 commit comments

Comments
 (0)