You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: pipeline/outputs/kafka.md
+4-7Lines changed: 4 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,12 +11,12 @@ This plugin supports the following parameters:
11
11
| Key | Description | Default |
12
12
| :--- | :--- | :--- |
13
13
|`format`| Specify data format. Available formats: `json`, `msgpack`, `raw`. |`json`|
14
-
|`message_key`| Optional key to store the message |_none_|
14
+
|`message_key`| Optional key to store the message.|_none_|
15
15
|`message_key_field`| If set, the value of `message_key_field` in the record will indicate the message key. If not set nor found in the record, `message_key` will be used if set. |_none_|
16
16
|`timestamp_key`| Set the key to store the record timestamp |`@timestamp`|
|`brokers`| Single or multiple list of Kafka Brokers. For example, `192.168.1.3:9092`, `192.168.1.4:9092`. |_none_|
19
-
|`topics`| Single entry or list of topics separated by comma (,) that Fluent Bit will use to send messages to Kafka. If only one topic is set, that one will be used for all records. Instead if multiple topics exists, the one set in the record by `Topic_Key` will be used. | fluent-bit |
19
+
|`topics`| Single entry or list of topics separated by comma (,) that Fluent Bit will use to send messages to Kafka. If only one topic is set, that one will be used for all records. Instead if multiple topics exists, the one set in the record by `Topic_Key` will be used. |`fluent-bit`|
20
20
|`topic_key`| If multiple `topics` exist, the value of `Topic_Key` in the record will indicate the topic to use. For example, if `Topic_Key` is `router` and the record is `{"key1": 123, "router": "route_2"}`, Fluent Bit will use `topic _route_2_`. If the value of `Topic_Key` isn't present in `topics`, then the first topic in the `topics` list will indicate the topic to be used. |_none_|
21
21
|`dynamic_topic`| Adds unknown topics (found in `Topic_Key`) to `topics`. In `topics`, only a default topic needs to be configured. |`Off`|
22
22
|`queue_full_retries`| Fluent Bit queues data into `rdkafka` library. If the underlying library can't flush the records the queue might fill up, blocking new addition of records. `queue_full_retries` sets the number of local retries to enqueue the data. The interval between retries is 1 second. Setting the `queue_full_retries` value to `0` sets an unlimited number of retries. |`10`|
@@ -76,10 +76,7 @@ pipeline:
76
76
77
77
### Avro support
78
78
79
-
Fluent Bit comes with support for Avro encoding for the `out_kafka` plugin.
80
-
Avro support is optional and must be activated at build time by using a
81
-
build def with `cmake`: `-DFLB_AVRO_ENCODER=On` such as in the following
82
-
example which activates:
79
+
Fluent Bit comes with support for Avro encoding for the `out_kafka` plugin. Avro support is optional and must be activated at build time by using a build def with `cmake`: `-DFLB_AVRO_ENCODER=On` such as in the following example which activates:
83
80
84
81
-`out_kafka` with Avro encoding
85
82
- Fluent Bit Prometheus
@@ -244,7 +241,7 @@ Fluent Bit 4.0.4 and later supports authentication to Amazon MSK (Managed Stream
244
241
245
242
### Prerequisites
246
243
247
-
If you are compiling Fluent Bit from source, ensure the following requirements are met to enable AWS MSK IAM support:
244
+
If you are compiling Fluent Bit from source, ensure the following requirements are met to enable AWS MSK IAM support:
0 commit comments