Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,11 +1,19 @@
# {{ingest-pipelines-cap}} [ingest-pipelines]
---
mapped_urls:
- https://www.elastic.co/guide/en/serverless/current/ingest-pipelines.html
---

# Elasticsearch ingest pipelines (Serverless) [ingest-pipelines]

This content applies to: [![Elasticsearch](../../../images/serverless-es-badge.svg "")](../../../solutions/search.md) [![Observability](../../../images/serverless-obs-badge.svg "")](../../../solutions/observability.md) [![Security](../../../images/serverless-sec-badge.svg "")](../../../solutions/security/elastic-security-serverless.md)

[{{ingest-pipelines-cap}}](../../../manage-data/ingest/transform-enrich/ingest-pipelines.md) let you perform common transformations on your data before indexing. For example, you can use pipelines to remove fields, extract values from text, and enrich your data.
{{es}} ingest pipelines let you perform common transformations on your data before indexing. For example, you can use pipelines to remove fields, extract values from text, and enrich your data.

A pipeline consists of a series of configurable tasks called processors. Each processor runs sequentially, making specific changes to incoming documents. After the processors have run, {{es}} adds the transformed documents to your data stream or index.

:::{image} ../../../images/elasticsearch-reference-ingest-process.svg
:alt: Ingest pipeline diagram
:::

## Create and manage pipelines [ingest-pipelines-create-and-manage-pipelines]

Expand All @@ -20,7 +28,7 @@ In **{{project-settings}} → {{manage-app}} → {{ingest-pipelines-app}}**, you
:class: screenshot
:::

To create a pipeline, click **Create pipeline → New pipeline**. For an example tutorial, see [Example: Parse logs](../../../manage-data/ingest/transform-enrich/example-parse-logs.md).
To create a pipeline, click **Create pipeline → New pipeline**. For an example tutorial, see [Example: Parse logs](example-parse-logs.md).

The **New pipeline from CSV** option lets you use a file with comma-separated values (CSV) to create an ingest pipeline that maps custom data to the Elastic Common Schema (ECS). Mapping your custom data to ECS makes the data easier to search and lets you reuse visualizations from other data sets. To get started, check [Map custom data to ECS](https://www.elastic.co/guide/en/ecs/{{ecs_version}}/ecs-converting.html).

Expand Down
Loading
Loading