Merge remote-tracking branch 'upstream/master' into jszwedko/document-dd_hostname

Author: jszwedko

.gitbook/assets/3.1.png

@@ -2,4 +2,4 @@ _book/*
 node_modules/*
 .gitignore
 old/*
-
+.DS_Store

.gitbook/assets/3.2.png

@@ -0,0 +1,17 @@
+StylesPath = vale-styles
+MinAlertLevel = suggestion # suggestion, warning or error
+
+[formats]
+mdx = md
+
+[*.{md,markdown,txt,htm,html}]
+BasedOnStyles = FluentBit
+IgnoredScopes = tt, code
+
+FluentBit.Terms = YES
+FluentBit.Titles = YES
+FluentBit.FutureTense = NO
+FluentBit.Headings = NO
+FluentBit.Passive = NO
+FluentBit.Subjunctive = NO
+FluentBit.Colons = NO

.gitbook/assets/image.png

@@ -32,7 +32,7 @@ the docs library. If you create a new page, you'll also need to update
 
 ## Workflow
 
-After you open a pull request in this repo, a Fluent Bit maintainer will review
+After you open a pull request in this repository, a Fluent Bit maintainer will review
 it, triage it, add comments or suggestions as needed, and then merge it. After
 your changes are successfully merged into `master`, the docs site will update
 within a few minutes.
@@ -99,9 +99,9 @@ To prevent DCO errors, refer to the following guide about
 >
 > `git commit -a -s -m "pipeline: outputs: syslog: fix grammar in examples"`
 >
-> If you're using VS Code, you can also enable the
+> If you're using VSCode, you can also enable the
 > [**Git: Always Sign Off**](https://github.com/microsoft/vscode/issues/83096#issuecomment-545350047)
-> setting, whch automatically appends a `Signed-off-by:` message to your commits.
+> setting, which automatically appends a `Signed-off-by:` message to your commits.
 
 ## Style guidelines
 
@@ -111,8 +111,16 @@ for most topics related to grammar, style, and formatting. We don't expect you
 to memorize these style rules, but the technical writer who reviews your pull
 request may suggest changes accordingly.
 
+### URLs
+
+When cross-linking to a page in this repository, use a full relative path whenever
+possible. For example:
+
+```text
+[LTSV](pipeline/parsers/ltsv.md) and [Logfmt](pipeline/parsers/logfmt.md)
+```
+
 ### Vale
 
-The Fluent Bit maintainers are working to add a [Vale](https://vale.sh/docs/) plugin
-to this repository, which will automatically lint pull requests and add
-suggestions to improve style and clarity.
+The Fluent Bit maintainers use the [Vale](https://vale.sh/docs/) plugin, which lints
+pull requests and adds suggestions to improve style and clarity.

.gitignore

@@ -2,39 +2,55 @@
 description: High Performance Telemetry Agent for Logs, Metrics and Traces
 ---
 
-# Fluent Bit v3.1 Documentation
+# Fluent Bit v3.2 Documentation
 
-<figure><img src=".gitbook/assets/3.0.png" alt=""><figcaption></figcaption></figure>
+<figure><img src=".gitbook/assets/3.2.png" alt=""><figcaption></figcaption></figure>
 
-[Fluent Bit](http://fluentbit.io) is a Fast and Lightweight **Telemetry Agent** for Logs, Metrics, and Traces for Linux, macOS, Windows, and BSD family operating systems. It has been made with a strong focus on performance to allow the collection and processing of telemetry data from different sources without complexity.![](https://static.scarf.sh/a.png?x-pxid=71f0e011-761f-4c6f-9a89-38817887faae)
+[Fluent Bit](http://fluentbit.io) is a fast and lightweight telemetry agent
+for logs, metrics, and traces for Linux, macOS, Windows, and BSD family
+operating systems. Fluent Bit has been made with a strong focus on performance to allow
+the collection and processing of telemetry data from different sources without
+complexity.![](https://static.scarf.sh/a.png?x-pxid=71f0e011-761f-4c6f-9a89-38817887faae)
 
 ## Features
 
-* High Performance: High throughput with low resources consumption
-* Data Parsing
-  * Convert your unstructured messages using our parsers: [JSON](pipeline/parsers/json.md), [Regex](pipeline/parsers/regular-expression.md), [LTSV](pipeline/parsers/ltsv.md) and [Logfmt](pipeline/parsers/logfmt.md)
-* Metrics Support: Prometheus and OpenTelemetry compatible
-* Reliability and Data Integrity
-  * [Backpressure](administration/backpressure.md) Handling
-  * [Data Buffering](administration/buffering-and-storage.md) in memory and file system
-* Networking
-  * Security: built-in TLS/SSL support
-  * Asynchronous I/O
-* Pluggable Architecture and [Extensibility](development/library_api.md): Inputs, Filters and Outputs
-  * Connect nearly any source to nearly any destination using preexisting plugins
-  * Extensibility
-    * Write any input, filter or output plugin in C language
-    * WASM: [WASM Filter Plugins](development/wasm-filter-plugins.md) or [WASM Input Plugins](development/wasm-input-plugins.md)
-    * Bonus: write [Filters in Lua](pipeline/filters/lua.md) or [Output plugins in Golang](development/golang-output-plugins.md)
-* [Monitoring](administration/monitoring.md): expose internal metrics over HTTP in JSON and [Prometheus](https://prometheus.io/) format
-* [Stream Processing](stream-processing/introduction.md): Perform data selection and transformation using simple SQL queries
-  * Create new streams of data using query results
-  * Aggregation Windows
-  * Data analysis and prediction: Timeseries forecasting
-* Portable: runs on Linux, macOS, Windows and BSD systems
+- High performance: High throughput with low resources consumption
+- Data parsing
+  - Convert your unstructured messages using our parsers:
+    [JSON](pipeline/parsers/json.md),
+    [Regex](pipeline/parsers/regular-expression.md),
+    [LTSV](pipeline/parsers/ltsv.md) and [Logfmt](pipeline/parsers/logfmt.md)
+- Metrics support: Prometheus and OpenTelemetry compatible
+- Reliability and data integrity
+  - [Backpressure](administration/backpressure.md) handling
+  - [Data buffering](administration/buffering-and-storage.md) in memory and file system
+- Networking
+  - Security: Built-in TLS/SSL support
+  - Asynchronous I/O
+- Pluggable architecture and [extensibility](development/library_api.md): Inputs,
+  Filters and Outputs:
+  - Connect nearly any source to nearly any destination using preexisting plugins
+  - Extensibility:
+    - Write input, filter, or output plugins in the C language
+    - WASM: [WASM Filter Plugins](development/wasm-filter-plugins.md) or
+      [WASM Input Plugins](development/wasm-input-plugins.md)
+    - Write [Filters in Lua](pipeline/filters/lua.md) or
+      [Output plugins in Golang](development/golang-output-plugins.md)
+- [Monitoring](administration/monitoring.md): Expose internal metrics over HTTP
+  in JSON and [Prometheus](https://prometheus.io/) format
+- [Stream Processing](stream-processing/introduction.md): Perform data selection
+  and transformation using simple SQL queries
+  - Create new streams of data using query results
+  - Aggregation windows
+  - Data analysis and prediction: Timeseries forecasting
+- Portable: Runs on Linux, macOS, Windows and BSD systems
 
 ## Fluent Bit, Fluentd and CNCF
 
-[Fluent Bit](http://fluentbit.io) is a [CNCF](https://cncf.io) **graduated** sub-project under the umbrella of [Fluentd](http://fluentd.org). Fluent Bit is licensed under the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0).
+[Fluent Bit](http://fluentbit.io) is a [CNCF](https://cncf.io) graduated sub-project
+under the umbrella of [Fluentd](http://fluentd.org). Fluent Bit is licensed under
+the terms of the [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0).
 
-Fluent Bit was originally created by [Eduardo Silva](https://www.linkedin.com/in/edsiper/). As a CNCF-hosted project, it is a fully **vendor-neutral** and community-driven project.
+Fluent Bit was originally created by [Eduardo Silva](https://www.linkedin.com/in/edsiper/)
+and is now sponsored by [Chronosphere](https://chronosphere.io/). As a
+CNCF-hosted project, it is a fully vendor-neutral and community-driven project.

.vale.ini

@@ -1,6 +1,6 @@
 # Table of contents
 
-* [Fluent Bit v3.1 Documentation](README.md)
+* [Fluent Bit v3.2 Documentation](README.md)
 
 ## About
 
@@ -49,15 +49,22 @@
 ## Administration
 
 * [Configuring Fluent Bit](administration/configuring-fluent-bit/README.md)
+  * [YAML Configuration](administration/configuring-fluent-bit/yaml/README.md)
+    * [Service](administration/configuring-fluent-bit/yaml/service-section.md)
+    * [Parsers](administration/configuring-fluent-bit/yaml/parsers-section.md)
+    * [Multiline Parsers](administration/configuring-fluent-bit/yaml/multiline-parsers-section.md)
+    * [Pipeline](administration/configuring-fluent-bit/yaml/pipeline-section.md)
+    * [Plugins](administration/configuring-fluent-bit/yaml/plugins-section.md)
+    * [Upstream Servers](administration/configuring-fluent-bit/yaml/upstream-servers-section.md))
+    * [Environment Variables](administration/configuring-fluent-bit/yaml/environment-variables-section.md)
+    * [Includes](administration/configuring-fluent-bit/yaml/includes-section.md)
   * [Classic mode](administration/configuring-fluent-bit/classic-mode/README.md)
     * [Format and Schema](administration/configuring-fluent-bit/classic-mode/format-schema.md)
     * [Configuration File](administration/configuring-fluent-bit/classic-mode/configuration-file.md)
     * [Variables](administration/configuring-fluent-bit/classic-mode/variables.md)
     * [Commands](administration/configuring-fluent-bit/classic-mode/commands.md)
     * [Upstream Servers](administration/configuring-fluent-bit/classic-mode/upstream-servers.md)
     * [Record Accessor](administration/configuring-fluent-bit/classic-mode/record-accessor.md)
-  * [YAML Configuration](administration/configuring-fluent-bit/yaml/README.md)
-    * [Configuration File](administration/configuring-fluent-bit/yaml/configuration-file.md)
   * [Unit Sizes](administration/configuring-fluent-bit/unit-sizes.md)
   * [Multiline Parsing](administration/configuring-fluent-bit/multiline-parsing.md)
 * [Transport Security](administration/transport-security.md)
@@ -67,9 +74,11 @@
 * [Networking](administration/networking.md)
 * [Memory Management](administration/memory-management.md)
 * [Monitoring](administration/monitoring.md)
+* [Multithreading](administration/multithreading.md)
 * [HTTP Proxy](administration/http-proxy.md)
 * [Hot Reload](administration/hot-reload.md)
 * [Troubleshooting](administration/troubleshooting.md)
+* [Performance Tips](administration/performance.md)
 
 ## Local Testing
 
@@ -83,17 +92,18 @@
   * [Collectd](pipeline/inputs/collectd.md)
   * [CPU Log Based Metrics](pipeline/inputs/cpu-metrics.md)
   * [Disk I/O Log Based Metrics](pipeline/inputs/disk-io-metrics.md)
-  * [Docker Log Based Metrics](pipeline/inputs/docker-metrics.md)
   * [Docker Events](pipeline/inputs/docker-events.md)
+  * [Docker Log Based Metrics](pipeline/inputs/docker-metrics.md)
   * [Dummy](pipeline/inputs/dummy.md)
   * [Elasticsearch](pipeline/inputs/elasticsearch.md)
   * [Exec](pipeline/inputs/exec.md)
   * [Exec Wasi](pipeline/inputs/exec-wasi.md)
+  * [Ebpf](pipeline/inputs/ebpf.md)
   * [Fluent Bit Metrics](pipeline/inputs/fluentbit-metrics.md)
   * [Forward](pipeline/inputs/forward.md)
   * [Head](pipeline/inputs/head.md)
-  * [HTTP](pipeline/inputs/http.md)
   * [Health](pipeline/inputs/health.md)
+  * [HTTP](pipeline/inputs/http.md)
   * [Kafka](pipeline/inputs/kafka.md)
   * [Kernel Logs](pipeline/inputs/kernel-logs.md)
   * [Kubernetes Events](pipeline/inputs/kubernetes-events.md)
@@ -102,11 +112,12 @@
   * [Network I/O Log Based Metrics](pipeline/inputs/network-io-metrics.md)
   * [NGINX Exporter Metrics](pipeline/inputs/nginx.md)
   * [Node Exporter Metrics](pipeline/inputs/node-exporter-metrics.md)
+  * [OpenTelemetry](pipeline/inputs/opentelemetry.md)
   * [Podman Metrics](pipeline/inputs/podman-metrics.md)
-  * [Process Log Based Metrics](pipeline/inputs/process.md)
   * [Process Exporter Metrics](pipeline/inputs/process-exporter-metrics.md)
-  * [Prometheus Scrape Metrics](pipeline/inputs/prometheus-scrape-metrics.md)
+  * [Process Log Based Metrics](pipeline/inputs/process.md)
   * [Prometheus Remote Write](pipeline/inputs/prometheus-remote-write.md)
+  * [Prometheus Scrape Metrics](pipeline/inputs/prometheus-scrape-metrics.md)
   * [Random](pipeline/inputs/random.md)
   * [Serial Interface](pipeline/inputs/serial-interface.md)
   * [Splunk](pipeline/inputs/splunk.md)
@@ -118,7 +129,6 @@
   * [TCP](pipeline/inputs/tcp.md)
   * [Thermal](pipeline/inputs/thermal.md)
   * [UDP](pipeline/inputs/udp.md)
-  * [OpenTelemetry](pipeline/inputs/opentelemetry.md)
   * [Windows Event Log](pipeline/inputs/windows-event-log.md)
   * [Windows Event Log (winevtlog)](pipeline/inputs/windows-event-log-winevtlog.md)
   * [Windows Exporter Metrics](pipeline/inputs/windows-exporter-metrics.md)
@@ -131,7 +141,9 @@
   * [Decoders](pipeline/parsers/decoders.md)
 * [Processors](pipeline/processors/README.md)
   * [Content Modifier](pipeline/processors/content-modifier.md)
+  * [Labels](pipeline/processors/labels.md)
   * [Metrics Selector](pipeline/processors/metrics-selector.md)
+  * [OpenTelemetry Envelope](pipeline/processors/opentelemetry-envelope.md)
   * [SQL](pipeline/processors/sql.md)
 * [Filters](pipeline/filters/README.md)
   * [AWS Metadata](pipeline/filters/aws-metadata.md)
@@ -167,6 +179,7 @@
   * [Azure Logs Ingestion API](pipeline/outputs/azure_logs_ingestion.md)
   * [Counter](pipeline/outputs/counter.md)
   * [Datadog](pipeline/outputs/datadog.md)
+  * [Dynatrace](pipeline/outputs/dynatrace.md)
   * [Elasticsearch](pipeline/outputs/elasticsearch.md)
   * [File](pipeline/outputs/file.md)
   * [FlowCounter](pipeline/outputs/flowcounter.md)
@@ -185,9 +198,10 @@
   * [New Relic](pipeline/outputs/new-relic.md)
   * [NULL](pipeline/outputs/null.md)
   * [Observe](pipeline/outputs/observe.md)
-  * [Oracle Log Analytics](pipeline/outputs/oci-logging-analytics.md)
+  * [OpenObserve](pipeline/inputs/openobserve.md)
   * [OpenSearch](pipeline/outputs/opensearch.md)
   * [OpenTelemetry](pipeline/outputs/opentelemetry.md)
+  * [Oracle Log Analytics](pipeline/outputs/oci-logging-analytics.md)
   * [PostgreSQL](pipeline/outputs/postgresql.md)
   * [Prometheus Exporter](pipeline/outputs/prometheus-exporter.md)
   * [Prometheus Remote Write](pipeline/outputs/prometheus-remote-write.md)

CONTRIBUTING.md

@@ -1,33 +1,45 @@
 ---
-description: The Production Grade Telemetry Ecosystem
+description: The production grade telemetry ecosystem
 ---
 
-# Fluentd & Fluent Bit
+# Fluentd and Fluent Bit
 
-Telemetry data processing in general can be complex, and at scale a bit more, that's why [Fluentd](https://www.fluentd.org) was born. Fluentd has become more than a simple tool, it has grown into a fullscale ecosystem that contains SDKs for different languages and sub-projects like [Fluent Bit](https://fluentbit.io).
+Telemetry data processing can be complex, especially at scale. That's why
+[Fluentd](https://www.fluentd.org) was created. Fluentd is more than a simple tool,
+it's grown into a fullscale ecosystem that contains SDKs for different languages
+and subprojects like [Fluent Bit](https://fluentbit.io).
 
-On this page, we will describe the relationship between the [Fluentd](http://fluentd.org) and [Fluent Bit](http://fluentbit.io) open source projects, as a summary we can say both are:
+Here, we describe the relationship between the [Fluentd](http://fluentd.org)
+and [Fluent Bit](http://fluentbit.io) open source projects.
 
-* Licensed under the terms of Apache License v2.0
-* **Graduated** Hosted projects by the [Cloud Native Computing Foundation (CNCF)](https://cncf.io)
-* Production Grade solutions: deployed **million** of times every single day.
-* **Vendor neutral** and community driven projects
-* Widely Adopted by the Industry: trusted by all major companies like AWS, Microsoft, Google Cloud and hundreds of others.
+Both projects are:
 
-Both projects share a lot of similarities, [Fluent Bit](https://fluentbit.io) is fully designed and built on top of the best ideas of [Fluentd](https://www.fluentd.org) architecture and general design. Choosing which one to use depends on the end-user needs.
+- Licensed under the terms of Apache License v2.0.
+- Graduated hosted projects by the [Cloud Native Computing Foundation (CNCF)](https://cncf.io).
+- Production grade solutions: Deployed millions of times every single day.
+- Vendor neutral and community driven.
+- Widely adopted by the industry: Trusted by major companies like AWS, Microsoft,
+  Google Cloud, and hundreds of others.
+
+The projects have many similarities: [Fluent Bit](https://fluentbit.io) is
+designed and built on top of the best ideas of [Fluentd](https://www.fluentd.org)
+architecture and general design. Which one you choose depends on your end-users' needs.
 
 The following table describes a comparison of different areas of the projects:
 
-|              | Fluentd                                                           | Fluent Bit                                                        |
-| ------------ | ----------------------------------------------------------------- | ----------------------------------------------------------------- |
-| Scope        | Containers / Servers                                              | Embedded Linux / Containers / Servers                             |
-| Language     | C & Ruby                                                          | C                                                                 |
-| Memory       |  > 60MB                                                           | \~1MB                                                             |
-| Performance  | Medium Performance                                                | High Performance                                                  |
-| Dependencies | Built as a Ruby Gem, it requires a certain number of gems.        | Zero dependencies, unless some special plugin requires them.      |
-| Plugins      | More than 1000 external plugins are available                     | More than 100 built-in plugins are available                      |
+|  Attribute   | Fluentd               | Fluent Bit            |
+| ------------ | --------------------- | --------------------- |
+| Scope        | Containers / Servers  | Embedded Linux / Containers / Servers |
+| Language     | C & Ruby              | C                                     |
+| Memory       | Greater than 60 MB | Approximately 1 MB |
+| Performance  | Medium Performance    | High Performance                      |
+| Dependencies | Built as a Ruby Gem, depends on other gems. | Zero dependencies, unless required by a plugin. |
+| Plugins      | Over 1,000 external plugins available. | Over 100 built-in plugins available. |
 | License      | [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0) | [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0) |
 
-Both [Fluentd](https://www.fluentd.org) and [Fluent Bit](https://fluentbit.io) can work as Aggregators or Forwarders, they both can complement each other or use them as standalone solutions.\
-\
-In the recent years, Cloud Providers switched from Fluentd to Fluent Bit for performance and compatibility reasons. Fluent Bit is now considered the **next generation** solution.
+Both [Fluentd](https://www.fluentd.org) and [Fluent Bit](https://fluentbit.io)
+can work as Aggregators or Forwarders, and can complement each other or be used
+as standalone solutions.
+
+In the recent years, cloud providers have switched from Fluentd to Fluent Bit for
+performance and compatibility. Fluent Bit is now considered the next-generation solution.