Skip to content

Commit 426e94f

Browse files
Remove Content UI from 9.x+ documentation (#2674)
This PR removes the Content UI references from 9.x+ documentation as it was deprecated. Connected to: #2425 --------- Co-authored-by: Liam Thompson <[email protected]>
1 parent 15907bd commit 426e94f

File tree

2 files changed

+20
-18
lines changed

2 files changed

+20
-18
lines changed
279 KB
Loading

solutions/search/search-pipelines.md

Lines changed: 20 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,9 @@
22
mapped_pages:
33
- https://www.elastic.co/guide/en/elasticsearch/reference/8.18/ingest-pipeline-search.html
44
applies_to:
5-
stack:
5+
stack: ga
6+
deployment:
7+
ess: ga
68
products:
79
- id: elasticsearch
810
---
@@ -11,17 +13,17 @@ products:
1113

1214
You can manage ingest pipelines through Elasticsearch APIs or Kibana UIs.
1315

14-
The **Content** UI under **Search** has a set of tools for creating and managing indices optimized for search use cases (non-time series data). You can also manage your ingest pipelines in this UI.
16+
The **Pipelines** tab under **Build > Connectors** lets you manage the ingest pipeline used by the connector’s destination index. Here you can view the managed pipeline and adjust its settings. For general pipeline authoring, use **Stack Management > Ingest Pipelines.**
1517

16-
## Find pipelines in Content UI [ingest-pipeline-search-where]
18+
## Find pipelines [ingest-pipeline-search-where]
1719

18-
To work with ingest pipelines using these UI tools, you’ll be using the **Pipelines** tab on your search-optimized Elasticsearch index.
20+
To work with ingest pipelines using these UI tools, open the **Pipelines** tab.
1921

2022
To find this tab in the Kibana UI:
2123

22-
1. Go to **Search > Content > Elasticsearch indices**.
23-
2. Select the index you want to work with. For example, `search-my-index`.
24-
3. On the index’s overview page, open the **Pipelines** tab.
24+
1. Go to **Build > Connectors**.
25+
2. Select the connector you want to work with. For example, `azure-blob-storage`.
26+
3. On the conector’s page, open the **Pipelines** tab.
2527
4. From here, you can follow the instructions to create custom pipelines, and set up ML inference pipelines.
2628

2729
The tab is highlighted in this screenshot:
@@ -37,17 +39,17 @@ These tools can be particularly helpful by providing a layer of customization an
3739

3840
* providing consistent extraction of text from binary data types
3941
* ensuring consistent formatting
40-
* providing consistent sanitization steps (removing PII like phone numbers or SSN’s)
42+
* providing consistent sanitization steps (removing PII like phone numbers or SSNs)
4143

4244
It can be a lot of work to set up and manage production-ready pipelines from scratch. Considerations such as error handling, conditional execution, sequencing, versioning, and modularization must all be taken into account.
4345

44-
To this end, when you create indices for search use cases, (including web crawler, content connectors and API indices), each index already has a pipeline set up with several processors that optimize your content for search.
46+
To this end, when you create indices for search use cases, (including connectors and API indices), each index already has a pipeline set up with several processors that optimize your content for search.
4547

4648
This pipeline is called `search-default-ingestion`. While it is a "managed" pipeline (meaning it should not be tampered with), you can view its details via the Kibana UI or the Elasticsearch API. You can also [read more about its contents below](#ingest-pipeline-search-details-generic-reference).
4749

48-
You can control whether you run some of these processors. While all features are enabled by default, they are eligible for opt-out. For [Elastic crawler](https://www.elastic.co/guide/en/enterprise-search/current/crawler.html) and [connectors](elasticsearch://reference/search-connectors/index.md). , you can opt out (or back in) per index, and your choices are saved. For API indices, you can opt out (or back in) by including specific fields in your documents. [See below for details](#ingest-pipeline-search-pipeline-settings-using-the-api).
50+
You can control whether you run some of these processors. While all features are enabled by default, they are eligible for opt-out. For [connectors](elasticsearch://reference/search-connectors/index.md), you can opt out (or back in) per index, and your choices are saved. For API indices, you can opt out (or back in) by including specific fields in your documents. [See below for details](#ingest-pipeline-search-pipeline-settings-using-the-api).
4951

50-
At the deployment level, you can change the default settings for all new indices. This will not effect existing indices.
52+
At the deployment level, you can change the default settings for all new indices. This will not affect existing indices.
5153

5254
Each index also provides the capability to easily create index-specific ingest pipelines with customizable processing. If you need that extra flexibility, you can create a custom pipeline by going to your pipeline settings and choosing to "copy and customize". This will replace the index’s use of `search-default-ingestion` with 3 newly generated pipelines:
5355

@@ -63,12 +65,12 @@ Like `search-default-ingestion`, the first of these is "managed", but the other
6365
Aside from the pipeline itself, you have a few configuration options which control individual features of the pipelines.
6466

6567
* **Extract Binary Content** - This controls whether or not binary documents should be processed and any textual content should be extracted.
66-
* **Reduce Whitespace** - This controls whether or not consecutive, leading, and trailing whitespaces should be removed. This can help to display more content in some search experiences.
68+
* **Reduce Whitespace** - This controls whether or not consecutive, leading, and trailing whitespace should be removed. This can help to display more content in some search experiences.
6769
* **Run ML Inference** - Only available on index-specific pipelines. This controls whether or not the optional `<index-name>@ml-inference` pipeline will be run. Enabled by default.
6870

69-
For Elastic web crawler and connectors, you can opt in or out per index. These settings are stored in Elasticsearch in the `.elastic-connectors` index, in the document that corresponds to the specific index. These settings can be changed there directly, or through the Kibana UI at **Search > Content > Indices > <your index> > Pipelines > Settings**.
71+
For connectors, you can opt in or out per index. These settings are stored in Elasticsearch in the `.elastic-connectors` index, in the document that corresponds to the specific index. These settings can be changed there directly, or through the Kibana UI at **Build > Connectors > Available connectors > <your connector> > Pipelines > Settings**.
7072

71-
You can also change the deployment wide defaults. These settings are stored in the Elasticsearch mapping for `.elastic-connectors` in the `_meta` section. These settings can be changed there directly, or from the Kibana UI at **Search > Content > Settings** tab. Changing the deployment wide defaults will not impact any existing indices, but will only impact any newly created indices defaults. Those defaults will still be able to be overridden by the index-specific settings.
73+
You can also change the deployment-wide defaults. These settings are stored in the Elasticsearch mapping for `.elastic-connectors` in the `_meta` section. These settings can be changed there directly, or from the Kibana UI at **Build > Connectors > Configuration** page. Changing the deployment-wide defaults will not impact any existing indices, but will only impact any newly created indices defaults. Those defaults will still be able to be overridden by the index-specific settings.
7274

7375

7476
### Using the API [ingest-pipeline-search-pipeline-settings-using-the-api]
@@ -130,12 +132,12 @@ The `search-default-ingestion` pipeline does not always run all processors. It u
130132
* `_extract_binary_content` - if this field is present and has a value of `true` on a source document, the pipeline will attempt to run the `attachment`, `set_body`, and `remove_replacement_chars` processors. Note that the document will also need an `_attachment` field populated with base64-encoded binary data in order for the `attachment` processor to have any output. If the `_extract_binary_content` field is missing or `false` on a source document, these processors will be skipped.
131133
* `_reduce_whitespace` - if this field is present and has a value of `true` on a source document, the pipeline will attempt to run the `remove_extra_whitespace` and `trim` processors. These processors only apply to the `body` field. If the `_reduce_whitespace` field is missing or `false` on a source document, these processors will be skipped.
132134

133-
Crawler, Native Connectors, and Connector Clients will automatically add these control flow parameters based on the settings in the index’s Pipeline tab. To control what settings any new indices will have upon creation, see the deployment wide content settings. See [Pipeline Settings](#ingest-pipeline-search-pipeline-settings).
135+
Connectors will automatically add these control flow parameters based on the settings in the index’s Pipeline tab. To control what settings any new indices will have upon creation, see the deployment-wide content settings. See [Pipeline Settings](#ingest-pipeline-search-pipeline-settings).
134136

135137

136138
### Index-specific ingest pipelines [ingest-pipeline-search-details-specific]
137139

138-
In the Kibana UI for your index, by clicking on the Pipelines tab, then **Settings > Copy and customize**, you can quickly generate 3 pipelines which are specific to your index. These 3 pipelines replace `search-default-ingestion` for the index. There is nothing lost in this action, as the `<index-name>` pipeline is a superset of functionality over the `search-default-ingestion` pipeline.
140+
In the Kibana UI for your index, by clicking on the **Pipelines** tab, then **Copy and customize**, you can quickly generate 3 pipelines which are specific to your index. These 3 pipelines replace `search-default-ingestion` for the index. There is nothing lost in this action, as the `<index-name>` pipeline is a superset of functionality over the `search-default-ingestion` pipeline.
139141

140142
::::{important}
141143
The "copy and customize" button is not available at all Elastic subscription levels. Refer to the Elastic subscriptions pages for [Elastic Cloud](https://www.elastic.co/subscriptions/cloud) and [self-managed](https://www.elastic.co/subscriptions) deployments.
@@ -175,14 +177,14 @@ Like the `search-default-ingestion` pipeline, the `<index-name>` pipeline does n
175177

176178
* `_run_ml_inference` - if this field is present and has a value of `true` on a source document, the pipeline will attempt to run the `index_ml_inference_pipeline` processor. If the `_run_ml_inference` field is missing or `false` on a source document, this processor will be skipped.
177179

178-
Crawler, Native Connectors, and Connector Clients will automatically add these control flow parameters based on the settings in the index’s Pipeline tab. To control what settings any new indices will have upon creation, see the deployment wide content settings. See [Pipeline Settings](#ingest-pipeline-search-pipeline-settings).
180+
Connectors will automatically add these control flow parameters based on the settings in the index’s Pipeline tab. To control what settings any new indices will have upon creation, see the deployment-wide content settings. See [Pipeline Settings](#ingest-pipeline-search-pipeline-settings).
179181

180182

181183
#### `<index-name>@ml-inference` Reference [ingest-pipeline-search-details-specific-ml-reference]
182184

183185
This pipeline is empty to start (no processors), but can be added to via the Kibana UI either through the Pipelines tab of your index, or from the **Stack Management > Ingest Pipelines** page. Unlike the `search-default-ingestion` pipeline and the `<index-name>` pipeline, this pipeline is NOT "managed".
184186

185-
It’s possible to add one or more ML inference pipelines to an index in the **Content** UI. This pipeline will serve as a container for all of the ML inference pipelines configured for the index. Each ML inference pipeline added to the index is referenced within `<index-name>@ml-inference` using a `pipeline` processor.
187+
It’s possible to add one or more ML inference pipelines to an index in the **Pipelines** tab. This pipeline will serve as a container for all of the ML inference pipelines configured for the index. Each ML inference pipeline added to the index is referenced within `<index-name>@ml-inference` using a `pipeline` processor.
186188

187189
::::{warning}
188190
You should not rename this pipeline.

0 commit comments

Comments
 (0)