Skip to content

Commit 6909ed4

Browse files
authored
Merge pull request #1488 from fluent/lynettemiles/sc-105700/update-concepts-data-pipeline-parser-md-fluent
2 parents b6c1825 + 9510f1d commit 6909ed4

File tree

1 file changed

+15
-6
lines changed

1 file changed

+15
-6
lines changed

concepts/data-pipeline/parser.md

Lines changed: 15 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,12 @@
11
---
2-
description: Convert Unstructured to Structured messages
2+
description: Convert unstructured messages to structured messages
33
---
44

55
# Parser
66

7-
Dealing with raw strings or unstructured messages is a constant pain; having a structure is highly desired. Ideally we want to set a structure to the incoming data by the Input Plugins as soon as they are collected:
7+
Dealing with raw strings or unstructured messages is difficult. Having a structure
8+
makes data more usable. Set a structure to the incoming data by using input
9+
plugins as data is collected:
810

911
```mermaid
1012
graph LR
@@ -19,13 +21,18 @@ graph LR
1921
E --> H[Output 3]
2022
style B stroke:darkred,stroke-width:2px;
2123
```
22-
The Parser allows you to convert from unstructured to structured data. As a demonstrative example consider the following Apache (HTTP Server) log entry:
2324

24-
```
25+
The parser converts unstructured data to structured data. As an example, consider the
26+
following Apache (HTTP Server) log entry:
27+
28+
```text
2529
192.168.2.20 - - [28/Jul/2006:10:27:10 -0300] "GET /cgi-bin/try/ HTTP/1.0" 200 3395
2630
```
2731

28-
The above log line is a raw string without format, ideally we would like to give it a structure that can be processed later easily. If the proper configuration is used, the log entry could be converted to:
32+
This log line is a raw string without format. Structuring the log makes it easier
33+
to process the data later. If the
34+
[regular expression parser](pipeline/parsers/regular-expression) is used, the log
35+
entry could be converted to:
2936

3037
```javascript
3138
{
@@ -40,4 +47,6 @@ The above log line is a raw string without format, ideally we would like to give
4047
}
4148
```
4249

43-
Parsers are fully configurable and are independently and optionally handled by each input plugin, for more details please refer to the [Parsers](https://docs.fluentbit.io/manual/pipeline/parsers) section.
50+
Parsers are fully configurable and are independently and optionally handled by each
51+
input plugin. For more details, see
52+
[Parsers](https://docs.fluentbit.io/manual/pipeline/parsers).

0 commit comments

Comments
 (0)