Skip to content

Commit e333fd2

Browse files
[Streams] Add note that manual pipeline config is classic streams only (#3918)
This PR closes #3915. --------- Co-authored-by: Nastasha Solomon <[email protected]>
1 parent a1a0f63 commit e333fd2

File tree

2 files changed

+17
-13
lines changed

2 files changed

+17
-13
lines changed

solutions/observability/streams/management/extract/manual-pipeline-configuration.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,13 +5,17 @@ applies_to:
55
---
66
# Manual pipeline configuration [streams-manual-pipeline-configuration]
77

8+
:::{note}
9+
The manual pipeline configuration processor is only available on [classic streams](../../streams.md#streams-classic-vs-wired).
10+
:::
11+
812
The **Manual pipeline configuration** lets you create a JSON-encoded array of ingest pipeline processors.This is helpful if you want to add more advanced processing that isn't currently available as part of the UI-based processors.
913

1014
Refer to the following documentation for more on manually configuring processors:
1115

1216
- [Create readable and maintainable ingest pipelines](../../../../../manage-data/ingest/transform-enrich/readable-maintainable-ingest-pipelines.md)
1317
- [Error handling in ingest pipelines](../../../../../manage-data/ingest/transform-enrich/error-handling.md)
14-
- [Ingest processor reference][elasticsearch://reference/enrich-processor.md]
18+
- [Ingest processor reference](elasticsearch://reference/enrich-processor/index.md)
1519

1620
To manually create an array of ingest pipeline processors:
1721

solutions/observability/streams/streams.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -8,11 +8,11 @@ applies_to:
88

99
Streams provides a single, centralized UI within {{kib}} that streamlines common tasks like extracting fields, setting data retention, and routing data, so you don't need to use multiple applications or manually configure underlying {{es}} components.
1010

11-
## Classic vs. wired streams
11+
## Classic versus wired streams [streams-classic-vs-wired]
1212

1313
Streams can operate in two modes: wired and classic. Both manage data streams in {{es}}, but differ in configuration, inheritance, and field mapping.
1414

15-
### Classic streams
15+
### Classic streams [streams-classic-streams]
1616

1717
Classic streams work with existing {{es}} data streams. Use classic streams when you want the ease of extracting fields and configuring data retention while working with data that's already being ingested into {{es}}.
1818

@@ -22,13 +22,13 @@ Classic streams:
2222
- Can follow the data retention policy set in the existing index template.
2323
- Do not support hierarchical inheritance or cascading configuration updates.
2424

25-
### Wired streams
25+
### Wired streams [streams-wired-streams]
2626
```{applies_to}
2727
stack: preview 9.2
2828
serverless: preview
2929
```
3030

31-
Wired streams data is sent directly to a single endpoint, from which you can route data into child streams based on [partitioning](./management/partitioning.md) set up manually or with the help of AI suggestions.
31+
Wired streams send data directly to a single endpoint, from which you can route data into child streams based on [partitioning](./management/partitioning.md) set up manually or with the help of AI suggestions.
3232

3333
Wired streams:
3434
- Allow you to organize streams in a parent-child hierarchy.
@@ -37,22 +37,22 @@ Wired streams:
3737

3838
For more information, refer to [sending data to wired streams](./wired-streams.md).
3939

40-
## Managed components
40+
## Managed components [streams-managed-components]
4141
When you configure classic or wired streams through the Streams UI or [Streams API](#streams-api), {{es}}-level components like templates and pipelines are created for the stream. These components are considered *managed* and shouldn't be modified using {{es}} APIs. When managing a stream through the Streams UI or API, continue doing so whenever possible.
4242

4343
You can still edit non-managed ingest pipelines, templates, and other components, but avoid those marked as managed or any per-data-stream mappings and settings. This behavior is similar to how Elasticsearch handles components managed by integrations. Refer to the [**Advanced** tab](./management/advanced.md) to review managed components.
4444

45-
## Required permissions
45+
## Required permissions [streams-required-permissions]
4646

4747
Streams requires the following permissions:
4848

4949
::::{tab-set}
5050

51-
:::{tab-item} Serverless
52-
Streams requires these Elastic Cloud Serverless roles:
51+
:::{tab-item} {{serverless-short}}
52+
Streams requires these {{serverless-full}} roles:
5353

5454
- Admin: Ability to manage all Streams
55-
- Editor/Viewer: Limited access, unable to perform all actions
55+
- Editor/Viewer: Limited access, cannot perform all actions
5656

5757
:::
5858

@@ -71,15 +71,15 @@ For more information, refer to [Cluster privileges](elasticsearch://reference/el
7171

7272
::::
7373

74-
## Access Streams
74+
## Access Streams [streams-access]
7575

7676
Open Streams from the following places in {{kib}}:
7777

7878
- Select **Streams** from the navigation menu or use the [global search field](../../../explore-analyze/find-and-organize/find-apps-and-objects.md).
7979

80-
- Open the data stream for a specific document from **Discover**. To do this, expand the details flyout for a document that's stored in a data stream, and select **Stream** or an action associated with the document's data stream. Streams will open filtered to the selected data stream.
80+
- Open the data stream for a specific document from **Discover**. To do this, expand the details flyout for a document that's stored in a data stream, and select **Stream** or an action associated with the document's data stream. Streams then opens filtered to the selected data stream.
8181

82-
### Streams API
82+
### Streams API [streams-api]
8383
``` yaml {applies_to}
8484
stack: preview 9.1
8585
serverless: preview

0 commit comments

Comments
 (0)