Skip to content

[kubernetes_filter]: Update documentation with the usage of Owner_References. #1576

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

[kubernetes_filter]: Update documentation with the usage of Owner_References. #1576

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions installation/docker.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,8 @@ Hub [fluent/fluent-bit](https://hub.docker.com/r/fluent/fluent-bit/) repository:

| Tag(s) | Manifest Architectures | Description |
| ------------ | ------------------------- | -------------------------------------------------------------- |
| 3.2.7-debug | x86_64, arm64v8, arm32v7, s390x | Debug images |
| 3.2.7 | x86_64, arm64v8, arm32v7, s390x | Release [v3.2.7](https://fluentbit.io/announcements/v3.2.7/) |
| 3.2.6-debug | x86_64, arm64v8, arm32v7, s390x | Debug images |
| 3.2.6 | x86_64, arm64v8, arm32v7, s390x | Release [v3.2.6](https://fluentbit.io/announcements/v3.2.6/) |
| 3.2.5-debug | x86_64, arm64v8, arm32v7, s390x | Debug images |
Expand Down
24 changes: 12 additions & 12 deletions installation/windows.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,31 +86,31 @@ after 1.9.9. The correct package name to use now is `fluent-bit`.

## Installation packages

The latest stable version is 3.2.6.
The latest stable version is 3.2.7.
Each version is available from the following download URLs.

| INSTALLERS | SHA256 CHECKSUMS |
|----------- | ---------------- |
| [fluent-bit-3.2.6-win32.exe](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win32.exe) | [39bfd4165337f823c6b556c8396ff5ded12db6c003de3279b349caec084d4a4e](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win32.exe.sha256) |
| [fluent-bit-3.2.6-win32.zip](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win32.zip) | [12db664855f77e2b5330e8e600319ecca4d3b3dbc74ecc90cf6dbabbac054d4a](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win32.zip.sha256) |
| [fluent-bit-3.2.6-win64.exe](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win64.exe) | [1e5b61b9645381e9cf845abd78a19b7004aafdc3278557329bfd4197f00f22f0](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win64.exe.sha256) |
| [fluent-bit-3.2.6-win64.zip](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win64.zip) | [7b14a8c6b94655f9d11791a5f44047bf80a4232363181b6d06d1bc49d79a76d0](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win64.zip.sha256) |
| [fluent-bit-3.2.6-winarm64.exe](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-winarm64.exe) | [96299b4a95231e97b3abdb0d57edbf2457254bc2cb1d4d84ca78ed867a8fb2f1](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-winarm64.exe.sha256) |
| [fluent-bit-3.2.6-winarm64.zip](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-winarm64.zip) | [04ce3c9654399dff2bfc1e166adba36169dd5068ce9fbeb8c6c3307bc1a720d7](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-winarm64.zip.sha256) |
| [fluent-bit-3.2.7-win32.exe](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win32.exe) | [178b0bf4fa1ee936b9c7262266e6661d81b407820d413854e341a9f42742cb6d](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win32.exe.sha256) |
| [fluent-bit-3.2.7-win32.zip](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win32.zip) | [34b104d5eb8f8598db46aee3a7a4d6edca797a65ec2ce49dc828f4a439082aa3](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win32.zip.sha256) |
| [fluent-bit-3.2.7-win64.exe](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win64.exe) | [d48a0b8518a6e1a662e3edd1825502191f7fc8fd8021f0a0356c81fa7c8c73f4](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win64.exe.sha256) |
| [fluent-bit-3.2.7-win64.zip](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win64.zip) | [da1d5817dc480ef22034f514339ec432c60d76ff6c9521039c1711a6a2edd8a5](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win64.zip.sha256) |
| [fluent-bit-3.2.7-winarm64.exe](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-winarm64.exe) | [03c94a1d51ed999b878d5247899ed70a7775473ea00fb01dd4ce4669d41d7984](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-winarm64.exe.sha256) |
| [fluent-bit-3.2.7-winarm64.zip](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-winarm64.zip) | [0fee82b1b8ccad1c415e6cfdc9be66f99ee341a21acb680999ceed5413fb149c](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-winarm64.zip.sha256) |

These are now using the Github Actions built versions. Legacy AppVeyor builds are
still available (AMD 32/64 only) at releases.fluentbit.io but are deprecated.

MSI installers are also available:

- [fluent-bit-3.2.6-win32.msi](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win32.msi)
- [fluent-bit-3.2.6-win64.msi](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-win64.msi)
- [fluent-bit-3.2.6-winarm64.msi](https://packages.fluentbit.io/windows/fluent-bit-3.2.6-winarm64.msi)
- [fluent-bit-3.2.7-win32.msi](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win32.msi)
- [fluent-bit-3.2.7-win64.msi](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-win64.msi)
- [fluent-bit-3.2.7-winarm64.msi](https://packages.fluentbit.io/windows/fluent-bit-3.2.7-winarm64.msi)

To check the integrity, use the `Get-FileHash` cmdlet for PowerShell.

```text copy
PS> Get-FileHash fluent-bit-3.2.6-win32.exe
PS> Get-FileHash fluent-bit-3.2.7-win32.exe
```

## Installing from a ZIP archive
Expand All @@ -122,7 +122,7 @@ PS> Get-FileHash fluent-bit-3.2.6-win32.exe
or `Expand-Archive` in PowerShell.

```text
PS> Expand-Archive fluent-bit-3.2.6-win64.zip
PS> Expand-Archive fluent-bit-3.2.7-win64.zip
```

The ZIP package contains the following set of files.
Expand Down
13 changes: 12 additions & 1 deletion pipeline/filters/kubernetes.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,10 @@ When Fluent Bit is deployed in Kubernetes as a DaemonSet and configured to read
* Namespace
* Container Name
* Container ID
* Query Kubernetes API Server to obtain extra metadata for the POD in question:
* Query Kubernetes API Server or Kubelet to obtain extra metadata for the POD in question:
* Pod ID
* Labels
* Owner References
* Annotations
* Namespace Labels
* Namespace Annotations
Expand Down Expand Up @@ -59,6 +60,7 @@ The plugin supports the following configuration parameters:
| Namespace\_Labels | Include Kubernetes namespace resource labels in the extra metadata. See [Kubernetes Namespace Meta](#kubernetes-namespace-meta)| Off |
| Namespace\_Annotations | Include Kubernetes namespace resource annotations in the extra metadata. See [Kubernetes Namespace Meta](#kubernetes-namespace-meta)| Off |
| Namespace\_Metadata\_Only | Include Kubernetes namespace metadata only and no pod metadata. If this is set, the values of `Labels` and `Annotations` are ignored. See [Kubernetes Namespace Meta](#kubernetes-namespace-meta)| Off |
| Owner\_References | Include Kubernetes owner references in the extra metadata | Off |

## Processing the 'log' value

Expand Down Expand Up @@ -156,6 +158,14 @@ spec:

Note that the annotation value is boolean which can take a _true_ or _false_ and **must** be quoted.

## Kubernetes Owner References

An opt-in feature of Fluent Bit Kubernetes filter to include owner references information under `kubernetes.ownerReferences` field in the record when enabled. An example of record is shown below.

```
"kubernetes"=>{"pod_name"=>"fluentbit-gke-2p6b5", "namespace_name"=>"kube-system", "pod_id"=>"c759a5f5-xxxx-xxxx-9117-8a1dc0b1f907", "labels"=>{"component"=>"xxxx", "controller-revision-hash"=>"77665fff9", "k8s-app"=>"fluentbit-xxxx"}, "ownerReferences"=>[{"apiVersion"=>"apps/v1", "kind"=>"DaemonSet", "name"=>"fluentbit-gke", "uid"=>"1a12c3e2-d6c4-4a8a-b877-dd3c857d1aea", "controller"=>true, "blockOwnerDeletion"=>true}], "host"=>"xxx-2a9c049c-qgw3", "pod_ip"=>"10.128.0.111", "container_name"=>"fluentbit", "docker_id"=>"2accxxx", "container_hash"=>"xxxx", "container_image"=>"sha256:5163dxxxxea2"}}
```

## Workflow of Tail + Kubernetes Filter

Kubernetes Filter depends on either [Tail](../inputs/tail.md) or [Systemd](../inputs/systemd.md) input plugins to process and enrich records with Kubernetes metadata. Here we will explain the workflow of Tail and how it configuration is correlated with Kubernetes filter. Consider the following configuration example \(just for demo purposes, not production\):
Expand Down Expand Up @@ -475,3 +485,4 @@ In some cases, you may only see some objects being appended with metadata while
Our Kubernetes Filter plugin is fully inspired by the [Fluentd Kubernetes Metadata
Filter](https://github.com/fabric8io/fluent-plugin-kubernetes\_metadata\_filter)
written by [Jimmi Dyson](https://github.com/jimmidyson).