Skip to content

Commit 69330da

Browse files
committed
Data pipeline: condense filters
Signed-off-by: Lynette Miles <[email protected]>
1 parent 343d97f commit 69330da

File tree

2 files changed

+9
-8
lines changed

2 files changed

+9
-8
lines changed

concepts/data-pipeline.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,13 @@
22

33
The Fluent Bit data pipeline incorporates several specific concepts.
44

5-
## Buffering
5+
## Buffer
66

77
The [`buffer`](./buffering.md) phase in the pipeline aims to provide a unified and persistent mechanism to store your data, using the primary in-memory model or the file system-based mode.
8+
9+
## Filter
10+
11+
In production environments you need full control of the data you're collecting. Filtering lets you alter the collected data before delivering it to a destination.
12+
For more details about the Filters available and their usage, see [Filters](https://docs.fluentbit.io/manual/pipeline/filters).
13+
14+
## Inputs

concepts/data-pipeline/filter.md renamed to pipeline/filters.md

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,4 @@
1-
---
2-
description: Modify, enrich or drop your records
3-
---
4-
5-
# Filter
1+
# Filters
62

73
In production environments you need full control of the data you're collecting. Filtering lets you alter the collected data before delivering it to a destination.
84

@@ -25,5 +21,3 @@ Filtering is implemented through plugins. Each available filter can be used to m
2521
Fluent Bit support many filters. A common use case for filtering is Kubernetes deployments. Every pod log needs the proper metadata associated with it.
2622

2723
Like input plugins, filters run in an instance context, which has its own independent configuration. Configuration keys are often called _properties_.
28-
29-
For more details about the Filters available and their usage, see [Filters](https://docs.fluentbit.io/manual/pipeline/filters).

0 commit comments

Comments
 (0)