Skip to content
Merged
48 changes: 30 additions & 18 deletions pipeline/outputs/counter.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,41 +14,53 @@ You can run the plugin from the command line or through the configuration file:

From the command line you can let Fluent Bit count up a data with the following options:

```bash
```shell
fluent-bit -i cpu -o counter
```

### Configuration File

In your main configuration file append the following Input & Output sections:
In your main configuration file append the following:

```python
{% tabs %}
{% tab title="fluent-bit.yaml" %}

```yaml
pipeline:
inputs:
- name: cpu
tag: cpu

outputs:
- name: counter
match: '*'
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[INPUT]
Name cpu
Tag cpu
Name cpu
Tag cpu

[OUTPUT]
Name counter
Match *
Name counter
Match *
```

{% endtab %}
{% endtabs %}

## Testing

Once Fluent Bit is running, you will see the reports in the output interface similar to this:

```bash
$ bin/fluent-bit -i cpu -o counter -f 1
Fluent Bit v1.x.x
* Copyright (C) 2019-2020 The Fluent Bit Authors
* Copyright (C) 2015-2018 Treasure Data
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2017/07/19 11:19:02] [ info] [engine] started
```shell
...
1500484743,1 (total = 1)
1500484744,1 (total = 2)
1500484745,1 (total = 3)
1500484746,1 (total = 4)
1500484747,1 (total = 5)
```

```
48 changes: 26 additions & 22 deletions pipeline/outputs/dash0.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,35 +27,39 @@ For more details about the properties available and general configuration, see [
To get started with sending logs to Dash0:

1. Get an [Auth Token](https://www.dash0.com/documentation/dash0/key-concepts/auth-tokens) from **Settings** > **Auth Tokens**.
1. In your main Fluent Bit configuration file, append the following `Output` section:
1. In your main Fluent Bit configuration file append the following:

{% tabs %}
{% tab title="fluent-bit.conf" %}
```text
[OUTPUT]
Name opentelemetry
Match *
Host ingress.eu-west-1.aws.dash0.com
Port 443
Header Authorization Bearer {your-Auth-token-here}
Metrics_uri /v1/metrics
Logs_uri /v1/logs
Traces_uri /v1/traces
{% tab title="fluent-bit.yaml" %}

```yaml
pipeline:

outputs:
- name: opentelemetry
match: '*'
host: ingress.eu-west-1.aws.dash0.com
port: 443
header: Authorization Bearer {your-Auth-token-here}
metrics_uri: /v1/metrics
logs_uri: /v1/logs
traces_uri: /v1/traces
```
{% endtab %}
{% tab title="fluent-bit.conf" %}

{% tab title="fluent-bit.yaml" %}
```yaml
```text
[OUTPUT]
Name: opentelemetry
Match: *
Host: ingress.eu-west-1.aws.dash0.com
Port: 443
Header: Authorization Bearer {your-Auth-token-here}
Metrics_uri: /v1/metrics
Logs_uri: /v1/logs
Traces_uri: /v1/traces
Name opentelemetry
Match *
Host ingress.eu-west-1.aws.dash0.com
Port 443
Header Authorization Bearer {your-Auth-token-here}
Metrics_uri /v1/metrics
Logs_uri /v1/logs
Traces_uri /v1/traces
```

{% endtab %}
{% endtabs %}

Expand Down
47 changes: 36 additions & 11 deletions pipeline/outputs/datadog.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,22 +33,47 @@ Before you begin, you need a [Datadog account](https://app.datadoghq.com/signup)

Get started quickly with this configuration file:

{% tabs %}
{% tab title="fluent-bit.yaml" %}

```yaml
pipeline:

outputs:
- name: datadog
match: '*'
host: http-intake.logs.datadoghq.com
tls: on
compress: gzip
apikey: <my-datadog-api-key>
dd_service: <my-app-service>
dd_source: <my-app-source>
dd_tags: team:logs,foo:bar
dd_hostname: myhost
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[OUTPUT]
Name datadog
Match *
Host http-intake.logs.datadoghq.com
TLS on
compress gzip
apikey <my-datadog-api-key>
dd_service <my-app-service>
dd_source <my-app-source>
dd_tags team:logs,foo:bar
dd_hostname myhost
Name datadog
Match *
Host http-intake.logs.datadoghq.com
TLS on
compress gzip
apikey <my-datadog-api-key>
dd_service <my-app-service>
dd_source <my-app-source>
dd_tags team:logs,foo:bar
dd_hostname myhost
```

{% endtab %}
{% endtabs %}

## Troubleshooting

### 403 Forbidden

If you get a `403 Forbidden` error response, double check that you have a valid [Datadog API key](https://docs.datadoghq.com/account_management/api-app-keys/) and that you have [activated Datadog Logs Management](https://app.datadoghq.com/logs/activation).
If you get a `403 Forbidden` error response, double check that you have a valid [Datadog API key](https://docs.datadoghq.com/account_management/api-app-keys/) and that you have [activated Datadog Logs Management](https://app.datadoghq.com/logs/activation).
64 changes: 47 additions & 17 deletions pipeline/outputs/dynatrace.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,23 +32,53 @@ To get started with sending logs to Dynatrace:
token with the `logs.ingest` (Ingest Logs) scope.
1. Determine your Dynatrace
[environment ID](https://docs.dynatrace.com/docs/shortlink/monitoring-environment#environment-id).
1. In your main Fluent Bit configuration file, append the following `Output` section:

```text
[OUTPUT]
name http
match *
header Content-Type application/json; charset=utf-8
header Authorization Api-Token {your-API-token-here}
allow_duplicated_headers false
host {your-environment-id}.live.dynatrace.com
Port 443
URI /api/v2/logs/ingest
Format json
json_date_format iso8601
json_date_key timestamp
tls On
tls.verify On
1. In your main Fluent Bit configuration file, append the following `Output` section:

{% tabs %}
{% tab title="fluent-bit.yaml" %}

```yaml
pipeline:

outputs:
- name: http
match: '*'
header:
- 'Content-Type application/json; charset=utf-8'
- 'Authorization Api-Token {your-API-token-here}'
allow_duplicated_headers: false
host: {your-environment-id}.live.dynatrace.com
port: 443
uri: /api/v2/logs/ingest
format: json
json_date_format: iso8601
json_date_key: timestamp
tls: on
tls.verify: on
```

{% endtab %}
{% tab title="fluent-bit.conf" %}

```text
[OUTPUT]
name http
match *
header Content-Type application/json; charset=utf-8
header Authorization Api-Token {your-API-token-here}
allow_duplicated_headers false
host {your-environment-id}.live.dynatrace.com
Port 443
URI /api/v2/logs/ingest
Format json
json_date_format iso8601
json_date_key timestamp
tls On
tls.verify On
```

{% endtab %}
{% endtabs %}

## References

Expand Down