Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
53 commits
Select commit Hold shift + click to select a range
2520a4c
Fixed code indents for examples in CollectD input plugin. Part of iss…
eschabell Jul 21, 2025
44bcc77
Fixed code indents for examples in CPU log based metrics input plugin…
eschabell Jul 21, 2025
7f672ba
Fixed code indents for examples in Disk I/O log based metrics input p…
eschabell Jul 21, 2025
da7fdc9
Fixed code indents for examples in Docker events input plugin. Part o…
eschabell Jul 21, 2025
e30e4ea
Fixed code indents for examples inDocker log based metrics input plug…
eschabell Jul 21, 2025
5d1af39
Fixed code indents for examples in Dummy input plugin. Part of issue …
eschabell Jul 21, 2025
98fd91a
Fixed code indents for examples in Ebpf input plugin. Part of issue #…
eschabell Jul 21, 2025
5e52ebe
Fixed code indents for examples in Elasticsearch input plugin. Part o…
eschabell Jul 21, 2025
fbd084e
Fixed code indents for examples and table format in Exec input plugin…
eschabell Jul 21, 2025
1f5bec9
Fixed table formatting to markdown standards for collectd intput plug…
eschabell Jul 21, 2025
ed96597
Fixed table formatting to markdown standards for cpu metrics intput p…
eschabell Jul 21, 2025
02871a9
Fixed table formatting to markdown standards for disk io log based me…
eschabell Jul 21, 2025
be97dc7
Fixed table formatting to markdown standards for docker events intput…
eschabell Jul 21, 2025
919976c
Fixed table formatting to markdown standards for docker log based met…
eschabell Jul 21, 2025
1583bd2
Fixed table formatting to markdown standards for dummy intput plugin.…
eschabell Jul 21, 2025
3ca5a81
Fixed table formatting to markdown standards for elasticsearch intput…
eschabell Jul 21, 2025
fa0af3c
Fixed table formatting to markdown standards for exec wasi intput plu…
eschabell Jul 21, 2025
85031a6
Fixed code indents for examples and table formatting in Fluent Bit Me…
eschabell Jul 21, 2025
ff308bf
Fixed code indents for examples and table formatting in Forward input…
eschabell Jul 21, 2025
9fb830a
Fixed code indents for examples and table formatting in Head input pl…
eschabell Jul 21, 2025
c84c5bb
Fixed code indents for examples and table formatting in Health input …
eschabell Jul 21, 2025
cb2620a
Fixed code indents for examples and table formatting in HTTP input pl…
eschabell Jul 21, 2025
9e013d7
Fixed code indents for examples and table formatting in Kafka input p…
eschabell Jul 21, 2025
4c99ec9
Fixed code indents for examples and table formatting in Kernel Log in…
eschabell Jul 21, 2025
5339e61
Fixed code indents for examples and table formatting in Kubernetes Ev…
eschabell Jul 21, 2025
bade33b
Fixed code indents for examples and table formatting in Memory Metric…
eschabell Jul 21, 2025
b875fcb
Fixed code indents for examples and table formatting in MQTT input pl…
eschabell Jul 21, 2025
f4b0273
Fixed code indents for examples and table formatting in Network I/O L…
eschabell Jul 21, 2025
de5f7f4
Fixed code indents for examples and table formatting in NGINX input p…
eschabell Jul 21, 2025
8ef1d78
Fixed code indents for examples and table formatting in NGINX input p…
eschabell Jul 21, 2025
dd2fbc2
Fixed code indents for examples and table formatting in Node Exporter…
eschabell Jul 21, 2025
d1dd574
Fixed code indents for examples and table formatting in OpenTelemtry …
eschabell Jul 21, 2025
ef91a2a
Fixed code indents for examples and table formatting in Podman Metric…
eschabell Jul 21, 2025
a5fc636
Fixed code indents for examples and table formatting in Process Log B…
eschabell Jul 21, 2025
f4ca6fe
Fixed code indents for examples and table formatting in Process Expor…
eschabell Jul 21, 2025
d29e355
Fixed code indents for examples and table formatting in Prometheus Re…
eschabell Jul 21, 2025
21f309d
Fixed code indents for examples and table formatting in Prometheus Sc…
eschabell Jul 21, 2025
8a181bc
Fixed code indents for examples and table formatting in Random input …
eschabell Jul 21, 2025
a9a40fc
Fixed code indents for examples and table formatting in Serial Interf…
eschabell Jul 21, 2025
3616076
Fixed code indents for examples and table formatting in Splunk input …
eschabell Jul 21, 2025
eb907fe
Fixed code indents for examples and table formatting in Standard Inpu…
eschabell Jul 21, 2025
3c019c2
Fixed code indents for examples and table formatting in StatsD input …
eschabell Jul 21, 2025
7eb2422
Fixed code indents for examples and table formatting in Syslog input …
eschabell Jul 21, 2025
6641399
Fixed code indents for examples and table formatting in Systemd input…
eschabell Jul 21, 2025
cad85d6
Fixed code indents for examples and table formatting in Tail input pl…
eschabell Jul 21, 2025
3cea800
Fixed code indents for examples and table formatting in TCP input plu…
eschabell Jul 21, 2025
cd413e7
Fixed code indents for examples and table formatting in Thermal input…
eschabell Jul 21, 2025
0e7dce5
Fixed code indents for examples and table formatting in UDP input plu…
eschabell Jul 21, 2025
5c9ed6d
Fixed code indents for examples and table formatting in Windows Event…
eschabell Jul 21, 2025
7626d65
Fixed code indents for examples and table formatting in Windows Event…
eschabell Jul 21, 2025
91a1ce5
Fixed code indents for examples and table formatting in Windows Expor…
eschabell Jul 21, 2025
418e6eb
Fixed shell useage in EBPF input plugin doc. Part of issue #1954.
eschabell Jul 21, 2025
cb5e39d
Fixed code indents for examples and table formatting in Windows Expor…
eschabell Jul 21, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
42 changes: 21 additions & 21 deletions pipeline/inputs/collectd.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,12 @@ The _Collectd_ input plugin lets you receive datagrams from the `collectd` servi

The plugin supports the following configuration parameters:

| Key | Description | Default |
| :--- | :--- | :--- |
| `Listen` | Set the address to listen to. | `0.0.0.0` |
| `Port` | Set the port to listen to. | `25826` |
| `TypesDB` | Set the data specification file. | `/usr/share/collectd/types.db` |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |
| Key | Description | Default |
|:-----------|:--------------------------------------------------------------------------------------------------------|:-------------------------------|
| `Listen` | Set the address to listen to. | `0.0.0.0` |
| `Port` | Set the port to listen to. | `25826` |
| `TypesDB` | Set the data specification file. | `/usr/share/collectd/types.db` |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |

## Configuration examples

Expand All @@ -22,30 +22,30 @@ Here is a basic configuration example:

```yaml
pipeline:
inputs:
- name: collectd
listen: 0.0.0.0
port: 25826
typesdb: '/user/share/collectd/types.db,/etc/collectd/custom.db'

outputs:
- name: stdout
match: '*'
inputs:
- name: collectd
listen: 0.0.0.0
port: 25826
typesdb: '/user/share/collectd/types.db,/etc/collectd/custom.db'

outputs:
- name: stdout
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[INPUT]
Name collectd
Listen 0.0.0.0
Port 25826
TypesDB /usr/share/collectd/types.db,/etc/collectd/custom.db
Name collectd
Listen 0.0.0.0
Port 25826
TypesDB /usr/share/collectd/types.db,/etc/collectd/custom.db

[OUTPUT]
Name stdout
Match *
Name stdout
Match *
```

{% endtab %}
Expand Down
61 changes: 28 additions & 33 deletions pipeline/inputs/cpu-metrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,30 +6,30 @@ The following tables describe the information generated by the plugin. The follo

The CPU metrics plugin creates metrics that are log-based, such as JSON payload. For Prometheus-based metrics, see the _Node Exporter Metrics_ input plugin.

| Key | Description |
| :--- | :--- |
| `cpu_p` | CPU usage of the overall system, this value is the summation of time spent on user and kernel space. The result takes in consideration the numbers of CPU cores in the system. |
| `user_p` | CPU usage in User mode, for short it means the CPU usage by user space programs. The result of this value takes in consideration the numbers of CPU cores in the system. |
| `system_p` | CPU usage in Kernel mode, for short it means the CPU usage by the Kernel. The result of this value takes in consideration the numbers of CPU cores in the system. |
| `threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). Default: `false`. |
| Key | Description |
|:-----------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| `cpu_p` | CPU usage of the overall system, this value is the summation of time spent on user and kernel space. The result takes in consideration the numbers of CPU cores in the system. |
| `user_p` | CPU usage in User mode, for short it means the CPU usage by user space programs. The result of this value takes in consideration the numbers of CPU cores in the system. |
| `system_p` | CPU usage in Kernel mode, for short it means the CPU usage by the Kernel. The result of this value takes in consideration the numbers of CPU cores in the system. |
| `threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). Default: `false`. |

In addition to the keys reported in the previous table, a similar content is created per CPU core. The cores are listed from `0` to `N` as the Kernel reports:

| Key | Description |
| :--- | :--- |
| `cpuN.p_cpu` | Represents the total CPU usage by core `N`. |
| `cpuN.p_user` | Total CPU spent in user mode or user space programs associated to this core. |
| `cpuN.p_system` | Total CPU spent in system or kernel mode associated to this core. |
| Key | Description |
|:----------------|:-----------------------------------------------------------------------------|
| `cpuN.p_cpu` | Represents the total CPU usage by core `N`. |
| `cpuN.p_user` | Total CPU spent in user mode or user space programs associated to this core. |
| `cpuN.p_system` | Total CPU spent in system or kernel mode associated to this core. |

## Configuration parameters

The plugin supports the following configuration parameters:

| Key | Description | Default |
| :--- | :--- | :--- |
| `Interval_Sec` | Polling interval in seconds. | `1` |
| `Interval_NSec | Polling interval in nanoseconds` | `0` |
| `PID` | Specify the `ID` (`PID`) of a running process in the system. By default, the plugin monitors the whole system but if this option is set, it will only monitor the given process ID. | _none_ |
| Key | Description | Default |
|:---------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------|
| `Interval_Sec` | Polling interval in seconds. | `1` |
| `Interval_NSec | Polling interval in nanoseconds` | `0` |
| `PID` | Specify the `ID` (`PID`) of a running process in the system. By default, the plugin monitors the whole system but if this option is set, it will only monitor the given process ID. | _none_ |

## Get started

Expand All @@ -46,17 +46,12 @@ build/bin/fluent-bit -i cpu -t my_cpu -o stdout -m '*'
The command returns results similar to the following:

```text
Fluent Bit v1.x.x
* Copyright (C) 2019-2020 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2019/09/02 10:46:29] [ info] starting engine
...
[0] [1452185189, {"cpu_p"=>7.00, "user_p"=>5.00, "system_p"=>2.00, "cpu0.p_cpu"=>10.00, "cpu0.p_user"=>8.00, "cpu0.p_system"=>2.00, "cpu1.p_cpu"=>6.00, "cpu1.p_user"=>4.00, "cpu1.p_system"=>2.00}]
[1] [1452185190, {"cpu_p"=>6.50, "user_p"=>5.00, "system_p"=>1.50, "cpu0.p_cpu"=>6.00, "cpu0.p_user"=>5.00, "cpu0.p_system"=>1.00, "cpu1.p_cpu"=>7.00, "cpu1.p_user"=>5.00, "cpu1.p_system"=>2.00}]
[2] [1452185191, {"cpu_p"=>7.50, "user_p"=>5.00, "system_p"=>2.50, "cpu0.p_cpu"=>7.00, "cpu0.p_user"=>3.00, "cpu0.p_system"=>4.00, "cpu1.p_cpu"=>6.00, "cpu1.p_user"=>6.00, "cpu1.p_system"=>0.00}]
[3] [1452185192, {"cpu_p"=>4.50, "user_p"=>3.50, "system_p"=>1.00, "cpu0.p_cpu"=>6.00, "cpu0.p_user"=>5.00, "cpu0.p_system"=>1.00, "cpu1.p_cpu"=>5.00, "cpu1.p_user"=>3.00, "cpu1.p_system"=>2.00}]
...
```

As described previously, the CPU input plugin gathers the overall usage every one second and flushed the information to the output on the fifth second. This example uses the `stdout` plugin to demonstrate the output records. In a real use-case you might want to flush this information to some central aggregator such as [Fluentd](http://fluentd.org) or [Elasticsearch](http://elastic.co).
Expand All @@ -71,26 +66,26 @@ In your main configuration file append the following:
```yaml

pipeline:
inputs:
- name: cpu
tag: my_cpu
inputs:
- name: cpu
tag: my_cpu

outputs:
- name: stdout
match: '*'
outputs:
- name: stdout
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```shell
[INPUT]
Name cpu
Tag my_cpu
Name cpu
Tag my_cpu

[OUTPUT]
Name stdout
Match *
Name stdout
Match *
```

{% endtab %}
Expand Down
51 changes: 23 additions & 28 deletions pipeline/inputs/disk-io-metrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,12 +8,12 @@ The _Disk I/O metrics_ plugin creates metrics that are log-based, such as JSON p

The plugin supports the following configuration parameters:

| Key | Description | Default |
| :--- | :--- | :--- |
| `Interval_Sec` | Polling interval (seconds). | `1` |
| `Interval_NSec` | Polling interval (nanosecond). | `0` |
| `Dev_Name` | Device name to limit the target (for example, `sda`). If not set, `in_disk` gathers information from all of disks and partitions. | all disks |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |
| Key | Description | Default |
|:----------------|:----------------------------------------------------------------------------------------------------------------------------------|:----------|
| `Interval_Sec` | Polling interval (seconds). | `1` |
| `Interval_NSec` | Polling interval (nanosecond). | `0` |
| `Dev_Name` | Device name to limit the target (for example, `sda`). If not set, `in_disk` gathers information from all of disks and partitions. | all disks |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |

## Get started

Expand All @@ -30,17 +30,12 @@ fluent-bit -i disk -o stdout
Which returns information like the following:

```text
Fluent Bit v1.x.x
* Copyright (C) 2019-2020 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2017/01/28 16:58:16] [ info] [engine] started
...
[0] disk.0: [1485590297, {"read_size"=>0, "write_size"=>0}]
[1] disk.0: [1485590298, {"read_size"=>0, "write_size"=>0}]
[2] disk.0: [1485590299, {"read_size"=>0, "write_size"=>0}]
[3] disk.0: [1485590300, {"read_size"=>0, "write_size"=>11997184}]
...
```

### Configuration file
Expand All @@ -52,30 +47,30 @@ In your main configuration file append the following:

```yaml
pipeline:
inputs:
- name: disk
tag: disk
interval_sec: 1
interval_nsec: 0

outputs:
- name: stdout
match: '*'
inputs:
- name: disk
tag: disk
interval_sec: 1
interval_nsec: 0

outputs:
- name: stdout
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[INPUT]
Name disk
Tag disk
Interval_Sec 1
Interval_NSec 0
Name disk
Tag disk
Interval_Sec 1
Interval_NSec 0

[OUTPUT]
Name stdout
Match *
Name stdout
Match *
```

{% endtab %}
Expand Down
34 changes: 17 additions & 17 deletions pipeline/inputs/docker-events.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,15 +6,15 @@ The _Docker events_ input plugin uses the Docker API to capture server events. A

This plugin supports the following configuration parameters:

| Key | Description | Default |
| :--- | :--- | :--- |
| `Unix_Path` | The docker socket Unix path. | `/var/run/docker.sock` |
| `Buffer_Size` | The size of the buffer used to read docker events in bytes. | `8192` |
| `Parser` | Specify the name of a parser to interpret the entry as a structured message. | _none_ |
| `Key` | When a message is unstructured (no parser applied), it's appended as a string under the key name `message`. | `message` |
| `Reconnect.Retry_limits`| The maximum number of retries allowed. The plugin tries to reconnect with docker socket when `EOF` is detected. | `5` |
| `Reconnect.Retry_interval`| The retry interval in seconds. | `1` |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |
| Key | Description | Default |
|:---------------------------|:----------------------------------------------------------------------------------------------------------------|:-----------------------|
| `Unix_Path` | The docker socket Unix path. | `/var/run/docker.sock` |
| `Buffer_Size` | The size of the buffer used to read docker events in bytes. | `8192` |
| `Parser` | Specify the name of a parser to interpret the entry as a structured message. | _none_ |
| `Key` | When a message is unstructured (no parser applied), it's appended as a string under the key name `message`. | `message` |
| `Reconnect.Retry_limits` | The maximum number of retries allowed. The plugin tries to reconnect with docker socket when `EOF` is detected. | `5` |
| `Reconnect.Retry_interval` | The retry interval in seconds. | `1` |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |

### Command line

Expand All @@ -33,24 +33,24 @@ In your main configuration file append the following:

```yaml
pipeline:
inputs:
- name: docker_events
inputs:
- name: docker_events

outputs:
- name: stdout
match: '*'
outputs:
- name: stdout
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[INPUT]
Name docker_events
Name docker_events

[OUTPUT]
Name stdout
Match *
Name stdout
Match *
```

{% endtab %}
Expand Down
35 changes: 18 additions & 17 deletions pipeline/inputs/docker-metrics.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,13 +6,13 @@ The _Docker_ input plugin you collect Docker container metrics, including memory

The plugin supports the following configuration parameters:

| Key | Description | Default |
| ------------ | ----------------------------------------------- | ------- |
| `Interval_Sec` | Polling interval in seconds | `1` |
| `Include` | A space-separated list of containers to include. | _none_ |
| `Exclude` | A space-separated list of containers to exclude. | _none_ |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |
| `path.containers` | Used to specify the container directory if Docker is configured with a custom `data-root` directory. | `/var/lib/docker/containers` |
| Key | Description | Default |
|-------------------|---------------------------------------------------------------------------------------------------------|------------------------------|
| `Interval_Sec` | Polling interval in seconds | `1` |
| `Include` | A space-separated list of containers to include. | _none_ |
| `Exclude` | A space-separated list of containers to exclude. | _none_ |
| `Threaded` | Indicates whether to run this input in its own [thread](../../administration/multithreading.md#inputs). | `false` |
| `path.containers` | Used to specify the container directory if Docker is configured with a custom `data-root` directory. | `/var/lib/docker/containers` |

If you set neither `Include` nor `Exclude`, the plugin will try to get metrics from all running containers.

Expand All @@ -25,25 +25,26 @@ The following example configuration collects metrics from two docker instances (

```yaml
pipeline:
inputs:
- name: docker
include: 6bab19c3a0f9 14159be4ca2c
inputs:
- name: docker
include: 6bab19c3a0f9 14159be4ca2c

outputs:
- name: stdout
match: '*'
outputs:
- name: stdout
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[INPUT]
Name docker
Include 6bab19c3a0f9 14159be4ca2c
Name docker
Include 6bab19c3a0f9 14159be4ca2c

[OUTPUT]
Name stdout
Match *
Name stdout
Match *
```

{% endtab %}
Expand Down
Loading