Skip to content

Commit b75d1f1

Browse files
edsipergitbook-bot
authored andcommitted
GitBook: [#150] parser: multiline: add a hint about multiple chunks handling
1 parent 97b0b49 commit b75d1f1

29 files changed

+461
-527
lines changed
12.7 KB
Loading
48 KB
Loading
48 KB
Loading
48.2 KB
Loading
48.2 KB
Loading
48.2 KB
Loading
48.2 KB
Loading

administration/configuring-fluent-bit/configuration-file.md

Lines changed: 45 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -17,26 +17,26 @@ In addition, it's also possible to split the main configuration file in multiple
1717

1818
* Include File
1919

20-
## Service <a id="config_section"></a>
20+
## Service <a href="config_section" id="config_section"></a>
2121

2222
The _Service_ section defines global properties of the service, the keys available as of this version are described in the following table:
2323

24-
| Key | Description | Default Value |
25-
| :--- | :--- | :--- |
26-
| Flush | Set the flush time in `seconds.nanoseconds`. The engine loop uses a Flush timeout to define when is required to flush the records ingested by input plugins through the defined output plugins. | 5 |
27-
| Grace | Set the grace time in `seconds` as Integer value. The engine loop uses a Grace timeout to define wait time on exit | 5 |
28-
| Daemon | Boolean value to set if Fluent Bit should run as a Daemon \(background\) or not. Allowed values are: yes, no, on and off. note: If you are using a Systemd based unit as the one we provide in our packages, do not turn on this option. | Off |
29-
| Log\_File | Absolute path for an optional log file. By default all logs are redirected to the standard error interface \(stderr\). | |
30-
| Log\_Level | Set the logging verbosity level. Allowed values are: error, warn, info, debug and trace. Values are accumulative, e.g: if 'debug' is set, it will include error, warning, info and debug. Note that _trace_ mode is only available if Fluent Bit was built with the _WITH\_TRACE_ option enabled. | info |
31-
| Parsers\_File | Path for a `parsers` configuration file. Multiple Parsers\_File entries can be defined within the section. | |
32-
| Plugins\_File | Path for a `plugins` configuration file. A _plugins_ configuration file allows to define paths for external plugins, for an example [see here](https://github.com/fluent/fluent-bit/blob/master/conf/plugins.conf). | |
33-
| Streams\_File | Path for the Stream Processor configuration file. To learn more about Stream Processing configuration go [here](../../stream-processing/introduction.md). | |
34-
| HTTP\_Server | Enable built-in HTTP Server | Off |
35-
| HTTP\_Listen | Set listening interface for HTTP Server when it's enabled | 0.0.0.0 |
36-
| HTTP\_Port | Set TCP Port for the HTTP Server | 2020 |
37-
| Coro\_Stack\_Size | Set the coroutines stack size in bytes. The value must be greater than the page size of the running system. Don't set too small value \(say 4096\), or coroutine threads can overrun the stack buffer. Do not change the default value of this parameter unless you know what you are doing. | 24576 |
38-
| scheduler.cap | Set a maximum retry time in second. The property is supported from v1.8.7. |2000|
39-
| scheduler.base | Set a base of exponential backoff. The property is supported from v1.8.7. |5|
24+
| Key | Description | Default Value |
25+
| --------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | ------------- |
26+
| Flush | Set the flush time in `seconds.nanoseconds`. The engine loop uses a Flush timeout to define when is required to flush the records ingested by input plugins through the defined output plugins. | 5 |
27+
| Grace | Set the grace time in `seconds` as Integer value. The engine loop uses a Grace timeout to define wait time on exit | 5 |
28+
| Daemon | Boolean value to set if Fluent Bit should run as a Daemon (background) or not. Allowed values are: yes, no, on and off. note: If you are using a Systemd based unit as the one we provide in our packages, do not turn on this option. | Off |
29+
| Log_File | Absolute path for an optional log file. By default all logs are redirected to the standard error interface (stderr). | |
30+
| Log_Level | Set the logging verbosity level. Allowed values are: error, warn, info, debug and trace. Values are accumulative, e.g: if 'debug' is set, it will include error, warning, info and debug. Note that _trace_ mode is only available if Fluent Bit was built with the _WITH_TRACE_ option enabled. | info |
31+
| Parsers_File | Path for a `parsers` configuration file. Multiple Parsers_File entries can be defined within the section. | |
32+
| Plugins_File | Path for a `plugins` configuration file. A _plugins_ configuration file allows to define paths for external plugins, for an example [see here](https://github.com/fluent/fluent-bit/blob/master/conf/plugins.conf). | |
33+
| Streams_File | Path for the Stream Processor configuration file. To learn more about Stream Processing configuration go [here](../../stream-processing/introduction.md). | |
34+
| HTTP_Server | Enable built-in HTTP Server | Off |
35+
| HTTP_Listen | Set listening interface for HTTP Server when it's enabled | 0.0.0.0 |
36+
| HTTP_Port | Set TCP Port for the HTTP Server | 2020 |
37+
| Coro_Stack_Size | Set the coroutines stack size in bytes. The value must be greater than the page size of the running system. Don't set too small value (say 4096), or coroutine threads can overrun the stack buffer. Do not change the default value of this parameter unless you know what you are doing. | 24576 |
38+
| scheduler.cap | Set a maximum retry time in second. The property is supported from v1.8.7. | 2000 |
39+
| scheduler.base | Set a base of exponential backoff. The property is supported from v1.8.7. | 5 |
4040

4141
The following is an example of a _SERVICE_ section:
4242

@@ -47,16 +47,16 @@ The following is an example of a _SERVICE_ section:
4747
Log_Level debug
4848
```
4949

50-
## Input <a id="config_input"></a>
50+
## Input <a href="config_input" id="config_input"></a>
5151

52-
An _INPUT_ section defines a source \(related to an input plugin\), here we will describe the base configuration for each _INPUT_ section. Note that each input plugin may add it own configuration keys:
52+
An _INPUT_ section defines a source (related to an input plugin), here we will describe the base configuration for each _INPUT_ section. Note that each input plugin may add it own configuration keys:
5353

54-
| Key | Description |
55-
| :--- | :--- |
56-
| Name | Name of the input plugin. |
57-
| Tag | Tag name associated to all records coming from this plugin. |
54+
| Key | Description |
55+
| ---- | ----------------------------------------------------------- |
56+
| Name | Name of the input plugin. |
57+
| Tag | Tag name associated to all records coming from this plugin. |
5858

59-
The _Name_ is mandatory and it let Fluent Bit know which input plugin should be loaded. The _Tag_ is mandatory for all plugins except for the _input forward_ plugin \(as it provides dynamic tags\).
59+
The _Name_ is mandatory and it let Fluent Bit know which input plugin should be loaded. The _Tag_ is mandatory for all plugins except for the _input forward_ plugin (as it provides dynamic tags).
6060

6161
### Example
6262

@@ -68,37 +68,37 @@ The following is an example of an _INPUT_ section:
6868
Tag my_cpu
6969
```
7070

71-
## Filter <a id="config_filter"></a>
71+
## Filter <a href="config_filter" id="config_filter"></a>
7272

73-
A _FILTER_ section defines a filter \(related to a filter plugin\), here we will describe the base configuration for each _FILTER_ section. Note that each filter plugin may add it own configuration keys:
73+
A _FILTER_ section defines a filter (related to an filter plugin), here we will describe the base configuration for each _FILTER_ section. Note that each filter plugin may add it own configuration keys:
7474

75-
| Key | Description | |
76-
| :--- | :--- | :--- |
77-
| Name | Name of the filter plugin. | |
78-
| Match | A pattern to match against the tags of incoming records. It's case sensitive and support the star \(\*\) character as a wildcard. | |
79-
| Match\_Regex | A regular expression to match against the tags of incoming records. Use this option if you want to use the full regex syntax. | |
75+
| Key | Description | |
76+
| ----------- | ------------------------------------------------------------------------------------------------------------------------------- | - |
77+
| Name | Name of the filter plugin. | |
78+
| Match | A pattern to match against the tags of incoming records. It's case sensitive and support the star (\*) character as a wildcard. | |
79+
| Match_Regex | A regular expression to match against the tags of incoming records. Use this option if you want to use the full regex syntax. | |
8080

81-
The _Name_ is mandatory and it let Fluent Bit know which filter plugin should be loaded. The _Match_ or _Match\_Regex_ is mandatory for all plugins. If both are specified, _Match\_Regex_ takes precedence.
81+
The _Name_ is mandatory and it let Fluent Bit know which filter plugin should be loaded. The _Match_ or _Match_Regex_ is mandatory for all plugins. If both are specified, _Match_Regex_ takes precedence.
8282

8383
### Example
8484

85-
The following is an example of a _FILTER_ section:
85+
The following is an example of an _FILTER_ section:
8686

8787
```python
8888
[FILTER]
8989
Name stdout
9090
Match *
9191
```
9292

93-
## Output <a id="config_output"></a>
93+
## Output <a href="config_output" id="config_output"></a>
9494

9595
The _OUTPUT_ section specify a destination that certain records should follow after a Tag match. The configuration support the following keys:
9696

97-
| Key | Description | |
98-
| :--- | :--- | :--- |
99-
| Name | Name of the output plugin. | |
100-
| Match | A pattern to match against the tags of incoming records. It's case sensitive and support the star \(\*\) character as a wildcard. | |
101-
| Match\_Regex | A regular expression to match against the tags of incoming records. Use this option if you want to use the full regex syntax. | |
97+
| Key | Description | |
98+
| ----------- | ------------------------------------------------------------------------------------------------------------------------------- | - |
99+
| Name | Name of the output plugin. | |
100+
| Match | A pattern to match against the tags of incoming records. It's case sensitive and support the star (\*) character as a wildcard. | |
101+
| Match_Regex | A regular expression to match against the tags of incoming records. Use this option if you want to use the full regex syntax. | |
102102

103103
### Example
104104

@@ -129,19 +129,19 @@ The following configuration file example demonstrates how to collect CPU metrics
129129
Match my*cpu
130130
```
131131

132-
## Visualize <a id="config_include_file"></a>
132+
## Visualize <a href="config_include_file" id="config_include_file"></a>
133133

134134
You can also visualize Fluent Bit INPUT, FILTER, and OUTPUT configuration via [https://config.calyptia.com](https://config.calyptia.com)
135135

136136
![](../../.gitbook/assets/image.png)
137137

138-
## Include File <a id="config_include_file"></a>
138+
## Include File <a href="config_include_file" id="config_include_file"></a>
139139

140-
To avoid complicated long configuration files is better to split specific parts in different files and call them \(include\) from one main file.
140+
To avoid complicated long configuration files is better to split specific parts in different files and call them (include) from one main file.
141141

142142
Starting from Fluent Bit 0.12 the new configuration command _@INCLUDE_ has been added and can be used in the following way:
143143

144-
```text
144+
```
145145
@INCLUDE somefile.conf
146146
```
147147

@@ -153,9 +153,8 @@ The configuration reader will try to open the path _somefile.conf_, if not found
153153

154154
The _@INCLUDE_ command only works at top-left level of the configuration line, it cannot be used inside sections.
155155

156-
Wildcard character \(\*\) is supported to include multiple files, e.g:
156+
Wildcard character (\*) is supported to include multiple files, e.g:
157157

158-
```text
158+
```
159159
@INCLUDE input_*.conf
160160
```
161-

0 commit comments

Comments
 (0)