Skip to content

Commit 9b319ea

Browse files
Move section about Logstash to bottom of Kafka output page (#1430) (#1436)
(cherry picked from commit b05a3ab) Co-authored-by: David Kilfoyle <[email protected]>
1 parent ec4fe5c commit 9b319ea

File tree

1 file changed

+30
-27
lines changed

1 file changed

+30
-27
lines changed

docs/en/ingest-management/fleet/fleet-settings-output-kafka.asciidoc

Lines changed: 30 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -5,33 +5,7 @@
55

66
Specify these settings to send data over a secure connection to Kafka. In the {fleet} <<output-settings,Output settings>>, make sure that the Kafka output type is selected.
77

8-
== Kafka output and using {ls} to index data to {es}
9-
10-
If you are considering using {ls} to ship the data from `kafka` to {es}, please
11-
be aware the structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
12-
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec in order
13-
to make sure the input doesn't edit the fields and their contents.
14-
15-
The data streams setup by the integrations expect to receive events having the same structure and
16-
field names as they were sent directly from an {agent}.
17-
18-
The structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
19-
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec.
20-
21-
Refer to the <<ls-output-settings,{ls} output for {agent}>> documentation for more details.
22-
23-
[source,yaml]
24-
----
25-
inputs {
26-
kafka {
27-
...
28-
ecs_compatibility => "disabled"
29-
codec => json { ecs_compatibility => "disabled" }
30-
...
31-
}
32-
}
33-
...
34-
----
8+
NOTE: If you plan to use {ls} to modify {agent} output data before it's sent to Kafka, please refer to our <<kafka-output-settings-ls-warning,guidance>> for doing so, further in on this page.
359

3610
[discrete]
3711
== General settings
@@ -559,4 +533,33 @@ include::../elastic-agent/configuration/outputs/output-shared-settings.asciidoc[
559533

560534
|===
561535

536+
[[kafka-output-settings-ls-warning]]
537+
== Kafka output and using {ls} to index data to {es}
538+
539+
If you are considering using {ls} to ship the data from `kafka` to {es}, please
540+
be aware the structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
541+
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec in order
542+
to make sure the input doesn't edit the fields and their contents.
543+
544+
The data streams setup by the integrations expect to receive events having the same structure and
545+
field names as they were sent directly from an {agent}.
546+
547+
The structure of the documents sent from {agent} to `kafka` must not be modified by {ls}.
548+
We suggest disabling `ecs_compatibility` on both the `kafka` input and the `json` codec.
549+
550+
Refer to the <<ls-output-settings,{ls} output for {agent}>> documentation for more details.
551+
552+
[source,yaml]
553+
----
554+
inputs {
555+
kafka {
556+
...
557+
ecs_compatibility => "disabled"
558+
codec => json { ecs_compatibility => "disabled" }
559+
...
560+
}
561+
}
562+
...
563+
----
564+
562565
:type!:

0 commit comments

Comments
 (0)