You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: concepts/data-pipeline/parser.md
+15-6Lines changed: 15 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,10 +1,12 @@
1
1
---
2
-
description: Convert Unstructured to Structured messages
2
+
description: Convert unstructured messages to structured messages
3
3
---
4
4
5
5
# Parser
6
6
7
-
Dealing with raw strings or unstructured messages is a constant pain; having a structure is highly desired. Ideally we want to set a structure to the incoming data by the Input Plugins as soon as they are collected:
7
+
Dealing with raw strings or unstructured messages is difficult. Having a structure
8
+
makes data more usable. Set a structure to the incoming data by using input
9
+
plugins as data is collected:
8
10
9
11
```mermaid
10
12
graph LR
@@ -19,13 +21,18 @@ graph LR
19
21
E --> H[Output 3]
20
22
style B stroke:darkred,stroke-width:2px;
21
23
```
22
-
The Parser allows you to convert from unstructured to structured data. As a demonstrative example consider the following Apache (HTTP Server) log entry:
23
24
24
-
```
25
+
The parser converts unstructured data to structured data. As an example, consider the
The above log line is a raw string without format, ideally we would like to give it a structure that can be processed later easily. If the proper configuration is used, the log entry could be converted to:
32
+
This log line is a raw string without format. Structuring the log makes it easier
33
+
to process the data later. If the
34
+
[regular expression parser](pipeline/parsers/regular-expression) is used, the log
35
+
entry could be converted to:
29
36
30
37
```javascript
31
38
{
@@ -40,4 +47,6 @@ The above log line is a raw string without format, ideally we would like to give
40
47
}
41
48
```
42
49
43
-
Parsers are fully configurable and are independently and optionally handled by each input plugin, for more details please refer to the [Parsers](https://docs.fluentbit.io/manual/pipeline/parsers) section.
50
+
Parsers are fully configurable and are independently and optionally handled by each
0 commit comments