Skip to content

Commit 83a2546

Browse files
committed
Merge branch 'transforms-error' of https://github.com/elastic/docs-content into transforms-error
2 parents 4655911 + f4bfa68 commit 83a2546

File tree

4 files changed

+45
-5
lines changed

4 files changed

+45
-5
lines changed

explore-analyze/elastic-inference/eis.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,10 @@
11
---
22
navigation_title: Elastic Inference Service (EIS)
33
applies_to:
4-
stack: ga 9.0
4+
stack: ga
55
serverless: ga
6+
deployment:
7+
self: unavailable
68
---
79

810
# Elastic {{infer-cap}} Service [elastic-inference-service-eis]

explore-analyze/elastic-inference/inference-api.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ The following section lists the default {{infer}} endpoints, identified by their
3030

3131
### Default endpoints for Elastic {{infer-cap}} Service (EIS)
3232

33-
- `.elser-2-elastic`: uses the [ELSER](/explore-analyze/machine-learning/nlp/ml-nlp-elser.md) trained model as an Elastic {{infer-cap}} Service for `sparse_embedding` tasks (recommended for English language text). The `model_id` is `.elser_model_2`. {applies_to}`stack: preview 9.1` {applies_to}`serverless: preview`
33+
- `.elser-2-elastic`: uses the [ELSER](/explore-analyze/machine-learning/nlp/ml-nlp-elser.md) trained model as an Elastic {{infer-cap}} Service for `sparse_embedding` tasks (recommended for English language text). The `model_id` is `.elser_model_2`. {applies_to}`stack: preview 9.1` {applies_to}`self: unavailable` {applies_to}`serverless: preview`
3434

3535
### Default endpoints used on ML-nodes
3636

reference/fleet/kafka-output-settings.md

Lines changed: 16 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -131,13 +131,27 @@ Use this option to set the Kafka topic for each {{agent}} event.
131131

132132
You can set a static topic, for example `elastic-agent`, or you can choose to set a topic dynamically based on an [Elastic Common Schema (ECS)](ecs://reference/index.md) field. Available fields include:
133133

134-
* `data_stream_type`
134+
* `data_stream.type`
135135
* `data_stream.dataset`
136136
* `data_stream.namespace`
137137
* `@timestamp`
138138
* `event-dataset`
139139

140-
You can also set a custom field. This is useful if you’re using the [`add_fields` processor](/reference/fleet/add_fields-processor.md) as part of your {{agent}} input. Otherwise, setting a custom field is not recommended.
140+
You can also set a custom field. This is useful if you need to construct a more complex or structured topic name.
141+
142+
To set a dynamic topic value for outputting {{agent}} data to Kafka, you can add the [`add_fields` processor](/reference/fleet/add_fields-processor.md) to any integration policies on your {{fleet}}-managed {{agents}}.
143+
144+
For example, the following `add_fields` processor creates a dynamic topic value by interpolating multiple [data stream fields](ecs://reference/ecs-data_stream.md):
145+
146+
```yaml
147+
- add_fields:
148+
target: ''
149+
fields:
150+
kafka_topic: '${data_stream.type}-${data_stream.dataset}-${data_stream.namespace}' <1>
151+
```
152+
1. Depending on the values of the data stream fields, this generates topic names such as `logs-nginx.access-production` or `metrics-system.cpu-staging` as the value of the custom `kafka_topic` field.
153+
154+
For more information, refer to [](/reference/fleet/agent-processors.md).
141155

142156

143157
### Header settings [_header_settings]

reference/fleet/kafka-output.md

Lines changed: 25 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ inputs {
6969

7070
The `kafka` output supports the following settings, grouped by category. Many of these settings have sensible defaults that allow you to run {{agent}} with minimal configuration.
7171

72-
* [Kafka output configuration settings](#output-kafka-commonly-used-settings)
72+
* [Commonly used settings](#output-kafka-commonly-used-settings)
7373
* [Authentication settings](#output-kafka-authentication-settings)
7474
* [Memory queue settings](#output-kafka-memory-queue-settings)
7575
* [Topics settings](#output-kafka-topics-settings)
@@ -164,6 +164,30 @@ Use these options to set the Kafka topic for each {{agent}} event.
164164
`topic` $$$kafka-topic-setting$$$
165165
: The default Kafka topic used for produced events.
166166

167+
You can set a static topic, for example `elastic-agent`, or you can choose to set a topic dynamically based on an [Elastic Common Schema (ECS)](ecs://reference/index.md) field. Available fields include:
168+
169+
* `data_stream.type`
170+
* `data_stream.dataset`
171+
* `data_stream.namespace`
172+
* `@timestamp`
173+
* `event-dataset`
174+
175+
You can also set a custom field. This is useful if you need to construct a more complex or structured topic name.
176+
177+
To set a dynamic topic value for outputting {{agent}} data to Kafka, you can add the [`add_fields` processor](/reference/fleet/add_fields-processor.md) to the input configuration settings of your standalone {{agent}}.
178+
179+
For example, the following `add_fields` processor creates a dynamic topic value by interpolating multiple [data stream fields](ecs://reference/ecs-data_stream.md):
180+
181+
```yaml
182+
- add_fields:
183+
target: ''
184+
fields:
185+
kafka_topic: '${data_stream.type}-${data_stream.dataset}-${data_stream.namespace}' <1>
186+
```
187+
1. Depending on the values of the data stream fields, this generates topic names such as `logs-nginx.access-production` or `metrics-system.cpu-staging` as the value of the custom `kafka_topic` field.
188+
189+
For more information, refer to [](/reference/fleet/agent-processors.md).
190+
167191

168192
## Partition settings [output-kafka-partition-settings]
169193

0 commit comments

Comments
 (0)