|
5 | 5 |
|
6 | 6 | Specify these settings to send data over a secure connection to Kafka. In the {fleet} <<output-settings,Output settings>>, make sure that the Kafka output type is selected. |
7 | 7 |
|
8 | | -== Kafka output and using {ls} to index data to {es} |
9 | | - |
10 | | -If you are considering using {ls} to ship the data from `kafka` to {es}, please |
11 | | -be aware the structure of the documents sent from {agent} to `kafka` must not be modified by {ls}. |
12 | | -We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec in order |
13 | | -to make sure the input doesn't edit the fields and their contents. |
14 | | - |
15 | | -The data streams setup by the integrations expect to receive events having the same structure and |
16 | | -field names as they were sent directly from an {agent}. |
17 | | - |
18 | | -The structure of the documents sent from {agent} to `kafka` must not be modified by {ls}. |
19 | | -We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec. |
20 | | - |
21 | | -Refer to the <<ls-output-settings,{ls} output for {agent}>> documentation for more details. |
22 | | - |
23 | | -[source,yaml] |
24 | | ----- |
25 | | -inputs { |
26 | | - kafka { |
27 | | - ... |
28 | | - ecs_compatibility => "disabled" |
29 | | - codec => json { ecs_compatibility => "disabled" } |
30 | | - ... |
31 | | - } |
32 | | -} |
33 | | -... |
34 | | ----- |
| 8 | +NOTE: If you plan to use {ls} to modify {agent} output data before it's sent to Kafka, please refer to our <<kafka-output-settings-ls-warning,guidance>> for doing so, further in on this page. |
35 | 9 |
|
36 | 10 | [discrete] |
37 | 11 | == General settings |
@@ -570,4 +544,33 @@ include::../elastic-agent/configuration/outputs/output-shared-settings.asciidoc[ |
570 | 544 |
|
571 | 545 | |=== |
572 | 546 |
|
| 547 | +[[kafka-output-settings-ls-warning]] |
| 548 | +== Kafka output and using {ls} to index data to {es} |
| 549 | + |
| 550 | +If you are considering using {ls} to ship the data from `kafka` to {es}, please |
| 551 | +be aware the structure of the documents sent from {agent} to `kafka` must not be modified by {ls}. |
| 552 | +We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec in order |
| 553 | +to make sure the input doesn't edit the fields and their contents. |
| 554 | + |
| 555 | +The data streams setup by the integrations expect to receive events having the same structure and |
| 556 | +field names as they were sent directly from an {agent}. |
| 557 | + |
| 558 | +The structure of the documents sent from {agent} to `kafka` must not be modified by {ls}. |
| 559 | +We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec. |
| 560 | + |
| 561 | +Refer to the <<ls-output-settings,{ls} output for {agent}>> documentation for more details. |
| 562 | + |
| 563 | +[source,yaml] |
| 564 | +---- |
| 565 | +inputs { |
| 566 | + kafka { |
| 567 | + ... |
| 568 | + ecs_compatibility => "disabled" |
| 569 | + codec => json { ecs_compatibility => "disabled" } |
| 570 | + ... |
| 571 | + } |
| 572 | +} |
| 573 | +... |
| 574 | +---- |
| 575 | + |
573 | 576 | :type!: |
0 commit comments