Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
54 changes: 26 additions & 28 deletions pipeline/inputs/elasticsearch.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,30 +28,15 @@ In order to start performing the checks, you can run the plugin from the command

From the command line you can configure Fluent Bit to handle Bulk API requests with the following options:

```bash
fluent-bit -i elasticsearch -p port=9200 -o stdout
```shell
$ fluent-bit -i elasticsearch -p port=9200 -o stdout
```

### Configuration file

In your configuration file append the following `Input` and `Output` sections:
In your configuration file append the following:

{% tabs %}
{% tab title="fluent-bit.conf" %}

```python
[INPUT]
name elasticsearch
listen 0.0.0.0
port 9200

[OUTPUT]
name stdout
match *
```

{% endtab %}

{% tab title="fluent-bit.yaml" %}

```yaml
Expand All @@ -67,29 +52,26 @@ pipeline:
```

{% endtab %}
{% endtabs %}

As described previously, the plugin will handle ingested Bulk API requests.
For large bulk ingestion, you might have to increase buffer size using the `buffer_max_size` and `buffer_chunk_size` parameters:

{% tabs %}
{% tab title="fluent-bit.conf" %}

```python
```text
[INPUT]
name elasticsearch
listen 0.0.0.0
port 9200
buffer_max_size 20M
buffer_chunk_size 5M

[OUTPUT]
name stdout
match *
```

{% endtab %}
{% endtabs %}

As described previously, the plugin will handle ingested Bulk API requests.
For large bulk ingestion, you might have to increase buffer size using the `buffer_max_size` and `buffer_chunk_size` parameters:

{% tabs %}
{% tab title="fluent-bit.yaml" %}

```yaml
Expand All @@ -106,6 +88,22 @@ pipeline:
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[INPUT]
name elasticsearch
listen 0.0.0.0
port 9200
buffer_max_size 20M
buffer_chunk_size 5M

[OUTPUT]
name stdout
match *
```

{% endtab %}
{% endtabs %}

Expand All @@ -130,4 +128,4 @@ For large log ingestion on these beat plugins, users might have to configure rat
processors:
- rate_limit:
limit: "200/s"
```
```