From ec882701ead8d7a974c2f9c538b9f7f9601edb1c Mon Sep 17 00:00:00 2001 From: Lucas Tembras Date: Fri, 1 Aug 2025 10:46:58 -0400 Subject: [PATCH 1/3] docs: added site configuration field to datadog docs Signed-off-by: Lucas Tembras --- pipeline/outputs/datadog.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/pipeline/outputs/datadog.md b/pipeline/outputs/datadog.md index 9b7f3cbe4..2bcb6868d 100644 --- a/pipeline/outputs/datadog.md +++ b/pipeline/outputs/datadog.md @@ -26,6 +26,7 @@ Before you begin, you need a [Datadog account](https://app.datadoghq.com/signup) | dd_tags | _Optional_ - The [tags](https://docs.datadoghq.com/tagging/) you want to assign to your logs in Datadog. If unset, Datadog will look for the tags in the [`ddtags` attribute](https://docs.datadoghq.com/api/latest/logs/#send-logs). | | | dd_message_key | By default, the plugin searches for the key 'log' and remap the value to the key 'message'. If the property is set, the plugin will search the property name key. | | | dd_hostname | The host the emitted logs should be associated with. If unset, Datadog expects the host to be set with `host`, `hostname`, or `syslog.hostname` attributes. See [Datadog Logs preprocessor documentation](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=host#preprocessing) for recognized attributes. | _none_ | +| site | _Optional_ - The Datadog site to send logs to. Use `datadoghq.com` for US or `datadoghq.eu` for EU. If not specified, defaults to `datadoghq.com`. | `datadoghq.com` | | workers | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` | | header | Add additional arbitrary HTTP header key/value pair. Multiple headers can be set. | _none_ | @@ -41,6 +42,7 @@ Get started quickly with this configuration file: TLS on compress gzip apikey + site datadoghq.com dd_service dd_source dd_tags team:logs,foo:bar From 7da6118c37d63b2bc9872af5f08df8ba2c206b66 Mon Sep 17 00:00:00 2001 From: Lucas Tembras Date: Fri, 1 Aug 2025 11:35:36 -0400 Subject: [PATCH 2/3] docs: made some minor formatting fixes Signed-off-by: Lucas Tembras --- pipeline/outputs/datadog.md | 104 ++++++++++++++++++++++-------------- 1 file changed, 65 insertions(+), 39 deletions(-) diff --git a/pipeline/outputs/datadog.md b/pipeline/outputs/datadog.md index 2bcb6868d..9f29b208e 100644 --- a/pipeline/outputs/datadog.md +++ b/pipeline/outputs/datadog.md @@ -4,53 +4,79 @@ description: Send logs to Datadog # Datadog -The Datadog output plugin allows to ingest your logs into [Datadog](https://app.datadoghq.com/signup). +The _Datadog_ output plugin lets you ingest your logs into [Datadog](https://app.datadoghq.com/signup). Before you begin, you need a [Datadog account](https://app.datadoghq.com/signup), a [Datadog API key](https://docs.datadoghq.com/account_management/api-app-keys/), and you need to [activate Datadog Logs Management](https://app.datadoghq.com/logs/activation). -## Configuration Parameters - -| Key | Description | Default | -| --------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------- | -------------------------------- | -| Host | _Required_ - The Datadog server where you are sending your logs. | `http-intake.logs.datadoghq.com` | -| TLS | _Required_ - End-to-end security communications security protocol. Datadog recommends setting this to `on`. | `off` | -| compress | _Recommended_ - compresses the payload in GZIP format, Datadog supports and recommends setting this to `gzip`. | | -| apikey | _Required_ - Your [Datadog API key](https://app.datadoghq.com/account/settings#api). | | -| Proxy | _Optional_ - Specify an HTTP Proxy. The expected format of this value is [http://host:port](http://host/:port). Note that _https_ is **not** supported yet. | | -| provider | To activate the remapping, specify configuration flag provider with value `ecs`. | | -| json_date_key | Date key name for output. | `timestamp` | -| include_tag_key | If enabled, a tag is appended to output. The key name is used `tag_key` property. | `false` | -| tag_key | The key name of tag. If `include_tag_key` is false, This property is ignored. | `tagkey` | -| dd_service | _Recommended_ - The human readable name for your service generating the logs (e.g. the name of your application or database). If unset, Datadog will look for the service using [Service Remapper](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=service#service-attribute)." | | -| dd_source | _Recommended_ - A human readable name for the underlying technology of your service (e.g. `postgres` or `nginx`). If unset, Datadog will look for the source in the [`ddsource` attribute](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=source#source-attribute). | | -| dd_tags | _Optional_ - The [tags](https://docs.datadoghq.com/tagging/) you want to assign to your logs in Datadog. If unset, Datadog will look for the tags in the [`ddtags` attribute](https://docs.datadoghq.com/api/latest/logs/#send-logs). | | -| dd_message_key | By default, the plugin searches for the key 'log' and remap the value to the key 'message'. If the property is set, the plugin will search the property name key. | | -| dd_hostname | The host the emitted logs should be associated with. If unset, Datadog expects the host to be set with `host`, `hostname`, or `syslog.hostname` attributes. See [Datadog Logs preprocessor documentation](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=host#preprocessing) for recognized attributes. | _none_ | -| site | _Optional_ - The Datadog site to send logs to. Use `datadoghq.com` for US or `datadoghq.eu` for EU. If not specified, defaults to `datadoghq.com`. | `datadoghq.com` | -| workers | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` | -| header | Add additional arbitrary HTTP header key/value pair. Multiple headers can be set. | _none_ | - -### Configuration File - -Get started quickly with this configuration file: +## Configuration parameters +This plugin uses the following configuration parameters: + +| Key | Description | Default | +| --- | ----------- | ------- | +| `Host` | The Datadog server where you are sending your logs. | `http-intake.logs.datadoghq.com` | +| `TLS` | End-to-end security communications security protocol. Datadog recommends setting this to `on`. | `off` | +| `compress` | Optional. Compresses the payload in GZIP format. Datadog supports and recommends setting this to `gzip`. | _none_ | +| `apikey` | Your [Datadog API key](https://app.datadoghq.com/account/settings#api). | _none_ | +| `Proxy` | Optional. Specifies an HTTP proxy. The expected format of this value is `http://host:port`. HTTPS isn't supported. | _none_ | +| `provider` | To activate remapping, specify the configuration flag provider with the value `ecs`. | _none_ | +| `json_date_key` | Date key name for output. | `timestamp` | +| `include_tag_key` | If enabled, a tag is appended to the output. The key name is used `tag_key` property. | `false` | +| `tag_key` | The key name of tag. If `include_tag_key` is `false`, this property is ignored. | `tagkey` | +| `dd_service` | Recommended. The human readable name for your service generating the logs. For example, the name of your application or database. If not set, Datadog looks for the service using [service remapper](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=service#service-attribute). | _none_ | +| `dd_source` | Recommended. A human-readable name for the underlying technology of your service like `postgres` or `nginx`. If unset, Datadog looks for the source in the [`ddsource` attribute](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=source#source-attribute). | _none_ | +| `dd_tags` | Optional. The [tags](https://docs.datadoghq.com/tagging/) you want to assign to your logs in Datadog. If unset, Datadog will look for the tags in the [`ddtags` attribute](https://docs.datadoghq.com/api/latest/logs/#send-logs). | _none_ | +| `dd_message_key` | By default, the plugin searches for the key `log` and remaps the value to the key `message`. If the property is set, the plugin will search the property name key. | _none_ | +| `dd_hostname` | The host the emitted logs should be associated with. If unset, Datadog expects the host to be set with `host`, `hostname`, or `syslog.hostname` attributes. See [Datadog Logs preprocessor documentation](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=host#preprocessing) for recognized attributes. | _none_ | +| `site` | Optional. The Datadog site to send logs to. Use `datadoghq.com` for US or `datadoghq.eu` for EU. If not specified, defaults to `datadoghq.com`. | `datadoghq.com` | +| `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` | +| `header` | Add additional arbitrary HTTP header key/value pair. Multiple headers can be set. | _none_ | + +### Configuration file + +Get started with this configuration file: + +{% tabs %} +{% tab title="fluent-bit.yaml" %} + +```yaml +pipeline: + + outputs: + - name: datadog + match: '*' + host: http-intake.logs.datadoghq.com + tls: on + compress: gzip + apikey: + site: datadoghq.com + dd_service: + dd_source: + dd_tags: team:logs,foo:bar + dd_hostname: myhost ``` + +{% endtab %} +{% tab title="fluent-bit.conf" %} + +```text [OUTPUT] - Name datadog - Match * - Host http-intake.logs.datadoghq.com - TLS on - compress gzip - apikey - site datadoghq.com - dd_service - dd_source - dd_tags team:logs,foo:bar - dd_hostname myhost + Name datadog + Match * + Host http-intake.logs.datadoghq.com + TLS on + compress gzip + apikey + site datadoghq.com + dd_service + dd_source + dd_tags team:logs,foo:bar + dd_hostname myhost ``` -## Troubleshooting +{% endtab %} +{% endtabs %} -### 403 Forbidden +## Troubleshooting If you get a `403 Forbidden` error response, double check that you have a valid [Datadog API key](https://docs.datadoghq.com/account_management/api-app-keys/) and that you have [activated Datadog Logs Management](https://app.datadoghq.com/logs/activation). From 97dac45936cbab131f28496016536861b0562796 Mon Sep 17 00:00:00 2001 From: Lucas Tembras <51347268+lucastemb@users.noreply.github.com> Date: Fri, 1 Aug 2025 13:31:52 -0400 Subject: [PATCH 3/3] docs: implemented suggestion Co-authored-by: Alexa Kreizinger Signed-off-by: Lucas Tembras <51347268+lucastemb@users.noreply.github.com> --- pipeline/outputs/datadog.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pipeline/outputs/datadog.md b/pipeline/outputs/datadog.md index 9f29b208e..7bf410ef9 100644 --- a/pipeline/outputs/datadog.md +++ b/pipeline/outputs/datadog.md @@ -28,7 +28,7 @@ This plugin uses the following configuration parameters: | `dd_tags` | Optional. The [tags](https://docs.datadoghq.com/tagging/) you want to assign to your logs in Datadog. If unset, Datadog will look for the tags in the [`ddtags` attribute](https://docs.datadoghq.com/api/latest/logs/#send-logs). | _none_ | | `dd_message_key` | By default, the plugin searches for the key `log` and remaps the value to the key `message`. If the property is set, the plugin will search the property name key. | _none_ | | `dd_hostname` | The host the emitted logs should be associated with. If unset, Datadog expects the host to be set with `host`, `hostname`, or `syslog.hostname` attributes. See [Datadog Logs preprocessor documentation](https://docs.datadoghq.com/logs/log_configuration/pipelines/?tab=host#preprocessing) for recognized attributes. | _none_ | -| `site` | Optional. The Datadog site to send logs to. Use `datadoghq.com` for US or `datadoghq.eu` for EU. If not specified, defaults to `datadoghq.com`. | `datadoghq.com` | +| `site` | Optional. The Datadog site to send logs to. Use `datadoghq.com` for US or `datadoghq.eu` for EU. If no value is specified, defaults to `datadoghq.com`. | `datadoghq.com` | | `workers` | The number of [workers](../../administration/multithreading.md#outputs) to perform flush operations for this output. | `0` | | `header` | Add additional arbitrary HTTP header key/value pair. Multiple headers can be set. | _none_ |