Skip to content

Commit 1020e74

Browse files
committed
Move section about Logstash to bottom of Kafka output page
1 parent 9eeb6a8 commit 1020e74

File tree

1 file changed

+30
-27
lines changed

1 file changed

+30
-27
lines changed

docs/en/ingest-management/fleet/fleet-settings-output-kafka.asciidoc

Lines changed: 30 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -5,33 +5,7 @@
55

66
Specify these settings to send data over a secure connection to Kafka. In the {fleet} <<output-settings,Output settings>>, make sure that the Kafka output type is selected.
77

8-
== Kafka output and using {ls} to index data to {es}
9-
10-
If you are considering using {ls} to ship the data from `kafka` to {es}, please
11-
be aware the structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
12-
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec in order
13-
to make sure the input doesn't edit the fields and their contents.
14-
15-
The data streams setup by the integrations expect to receive events having the same structure and
16-
field names as they were sent directly from an {agent}.
17-
18-
The structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
19-
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec.
20-
21-
Refer to the <<ls-output-settings,{ls} output for {agent}>> documentation for more details.
22-
23-
[source,yaml]
24-
----
25-
inputs {
26-
kafka {
27-
...
28-
ecs_compatibility => "disabled"
29-
codec => json { ecs_compatibility => "disabled" }
30-
...
31-
}
32-
}
33-
...
34-
----
8+
NOTE: If you plan to use {ls} to modify {agent} output data before it's sent to Kafka, please refer to our <<kafka-output-settings-ls-warning,guidance>> for doing so, further in on this page.
359

3610
[discrete]
3711
== General settings
@@ -570,4 +544,33 @@ include::../elastic-agent/configuration/outputs/output-shared-settings.asciidoc[
570544

571545
|===
572546

547+
[[kafka-output-settings-ls-warning]]
548+
== Kafka output and using {ls} to index data to {es}
549+
550+
If you are considering using {ls} to ship the data from `kafka` to {es}, please
551+
be aware the structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
552+
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec in order
553+
to make sure the input doesn't edit the fields and their contents.
554+
555+
The data streams setup by the integrations expect to receive events having the same structure and
556+
field names as they were sent directly from an {agent}.
557+
558+
The structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
559+
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec.
560+
561+
Refer to the <<ls-output-settings,{ls} output for {agent}>> documentation for more details.
562+
563+
[source,yaml]
564+
----
565+
inputs {
566+
kafka {
567+
...
568+
ecs_compatibility => "disabled"
569+
codec => json { ecs_compatibility => "disabled" }
570+
...
571+
}
572+
}
573+
...
574+
----
575+
573576
:type!:

0 commit comments

Comments
 (0)