Merge branch 'fluent:master' into master

Author: eschabell

SUMMARY.md

@@ -184,6 +184,7 @@
   * [Datadog](pipeline/outputs/datadog.md)
   * [Dynatrace](pipeline/outputs/dynatrace.md)
   * [Elasticsearch](pipeline/outputs/elasticsearch.md)
+  * [Exit](pipeline/outputs/exit.md)
   * [File](pipeline/outputs/file.md)
   * [Flow counter](pipeline/outputs/flowcounter.md)
   * [Forward](pipeline/outputs/forward.md)

pipeline/outputs/exit.md

@@ -0,0 +1,21 @@
+---
+description: Exit Fluent Bit after a number of flushes, records, or seconds.
+---
+
+# Exit
+
+The _exit_ plugin is a utility plugin which causes Fluent Bit to exit after one of the following occurs:
+
+- receiving a set number of records (`record_count`).
+- being flushed a set number of times (`flush_count`).
+- being flushed after a set number of seconds have transpired (`time_count`).
+
+At least one of these parameters must be set. If more than one is set the plugin exits when any one of the set conditions is met.
+
+## Configuration parameters
+
+| Key | Description | Default |
+| :--- | :--- | :--- |
+| `Record_Count` | Number of records to wait for before exiting. |  _none_ |
+| `Flush_Count` | Number of flushes to wait for before exiting.| _none_ |
+| `Time_Count` | Number of seconds to wait for before exiting. | _none_ |

pipeline/outputs/http.md

@@ -28,7 +28,7 @@ The plugin supports the following configuration parameters:
 | `http_method` | Specify `POST` versus `PUT` HTTP Method. | `POST` |
 | `header` | Add a HTTP header key/value pair. Multiple headers can be set. | _none_ |
 | `json_date_key` | Specify the name of the time key in the output record. To disable the time key, set the value to `false`. | `date` |
-| `json_date_format` | Specify the format of the date. Supported formats: `double`, `epoch`, `iso8601`, `java_sql_timestamp`. | `double` |
+| `json_date_format` | Specify the format of the date. Supported formats: `double`, `epoch`, `epoch_ms`, `iso8601`, `java_sql_timestamp`. | `double` |
 | `gelf_timestamp_key` | Specify the key to use for `timestamp` in `gelf` format. | _none_ |
 | `gelf_host_key` | Specify the key to use for the `host` in `gelf` format. | _none_ |
 | `gelf_short_message_key` | Specify the key to use as the `short` message in `gelf` format. | _none_ |

pipeline/outputs/s3.md

@@ -30,7 +30,7 @@ The [Prometheus success/retry/error metrics values](../../administration/monitor
 | `region`           | The AWS region of your S3 bucket. | `us-east-1` |
 | `bucket`           | S3 Bucket name                    | _none_ |
 | `json_date_key`    | Specify the time key name in the output record. To disable the time key, set the value to `false`. | `date` |
-| `json_date_format` | Specify the format of the date. Accepted values: `double`, `epoch`, `iso8601` (2018-05-30T09:39:52.000681Z), `_java_sql_timestamp_` (2018-05-30 09:39:52.000681). | `iso8601` |
+| `json_date_format` | Specify the format of the date. Accepted values: `double`, `epoch`, `epoch_ms`, `iso8601` (2018-05-30T09:39:52.000681Z), `_java_sql_timestamp_` (2018-05-30 09:39:52.000681). | `iso8601` |
 | `total_file_size`  | Specify file size in S3. Minimum size is `1M`. With `use_put_object On` the maximum size is `1G`. With multipart uploads, the maximum size is `50G`. | `100M` |
 | `upload_chunk_size` | The size of each part for multipart uploads. Max: 50M | 5,242,880 bytes  |
 | `upload_timeout`   | When this amount of time elapses, Fluent Bit uploads and creates a new file in S3. Set to `60m` to upload a new file every hour. | `10m`|

pipeline/outputs/standard-output.md

@@ -8,7 +8,7 @@ The _standard output_ plugin prints ingested data to standard output.
 | --- | ----------- | ------- |
 | `Format` | Specify the data format to be printed. Supported formats are `msgpack`, `json`, `json_lines` and `json_stream`. | `msgpack` |
 | `json_date_key`| Specify the name of the time key in the output record. To disable the time key set the value to `false`. | `date` |
-| `json_date_format` | Specify the format of the date. Supported formats are `double`, `epoch`, `iso8601` (for example, `2018-05-30T09:39:52.000681Z`) and `java_sql_timestamp` (for example, `2018-05-30 09:39:52.000681`). | `double` |
+| `json_date_format` | Specify the format of the date. Supported formats are `double`, `epoch`, `epoch_ms`, `iso8601` (for example, `2018-05-30T09:39:52.000681Z`) and `java_sql_timestamp` (for example, `2018-05-30 09:39:52.000681`). | `double` |
 | `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `1` |
 
 ### Command line

pipeline/outputs/tcp-and-tls.md

@@ -12,7 +12,7 @@ This plugin supports the following parameters:
 | `Port` | TCP Port of the target service. | `5170` |
 | `Format` | Specify the data format to be printed. Supported formats: `msgpack`, `json`, `json_lines`, `json_stream`. | `msgpack` |
 | `json_date_key`| Specify the name of the time key in the output record. To disable the time key, set the value to `false`. | `date` |
-| `json_date_format` | Specify the format of the date. Supported formats: `double`, `epoch`, `iso8601`, `java_sql_timestamp`. | `double` |
+| `json_date_format` | Specify the format of the date. Supported formats: `double`, `epoch`, `epoch_ms`, `iso8601`, `java_sql_timestamp`. | `double` |
 | `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `2` |
 
 ## TLS configuration parameters

pipeline/outputs/websocket.md

@@ -14,7 +14,7 @@ This plugin supports the following parameters:
 | `Header` | Add a HTTP header key/value pair. Multiple headers can be set.  | _none_ |
 | `Format` | Specify the data format to be used in the HTTP request body. Supported formats: `json`, `json_stream`, `json_lines`, `gelf`. | `msgpack` |
 | `json_date_key` | Specify the name of the date field in output. | `date` |
-| `json_date_format` | Specify the format of the date. Supported formats: `double`, `epoch`, `iso8601`, `java_sql_timestamp`. | `double` |
+| `json_date_format` | Specify the format of the date. Supported formats: `double`, `epoch`, `epoch_ms`, `iso8601`, `java_sql_timestamp`. | `double` |
 | `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` |
 
 ## Get started