ppc64le support

[sumitd2]

IBM Power (ppc64le) support. Built locally.

None

Enter [N/A] in the box, if an item is not applicable to your change.

Testing
Before we can approve your change; please submit the following in a comment:
(To be tested on CI)

• [ NA] Example configuration file for the change
• [ NA] Debug log output from testing the change

(To be tested on CI)

• [Y] Attached Valgrind output that shows no leaks or memory corruption was found

If this is a change to packaging of containers or native binaries then please confirm it works for all targets.
(To be tested on CI)

• [NA] Run local packaging test showing all targets (including any new ones) build.
• [ NA] Set ok-package-test label to test for all targets (requires maintainer to do).

Documentation

• [Y] Documentation required for this feature

Backporting

• [ NA] Backport to latest stable release.

---

Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.

[sumitd2]

[2025/03/24 08:07:29] [ info] [input] pausing cpu.0
[2025/03/24 08:07:29] [ info] [engine] service has stopped (0 pending tasks)
[2025/03/24 08:07:29] [ info] [input] pausing cpu.0
[2025/03/24 08:07:29] [ info] [output:stdout:stdout.0] thread worker #0 stopping...
[2025/03/24 08:07:29] [ info] [output:stdout:stdout.0] thread worker #0 stopped
==37873==
==37873== HEAP SUMMARY:
==37873==     in use at exit: 1,024 bytes in 1 blocks
==37873==   total heap usage: 22,924 allocs, 22,923 frees, 376,595,288 bytes allocated
==37873==
==37873== LEAK SUMMARY:
==37873==    definitely lost: 1,024 bytes in 1 blocks
==37873==    indirectly lost: 0 bytes in 0 blocks
==37873==      possibly lost: 0 bytes in 0 blocks
==37873==    still reachable: 0 bytes in 0 blocks
==37873==         suppressed: 0 bytes in 0 blocks
==37873== Rerun with --leak-check=full to see details of leaked memory
==37873==
==37873== For lists of detected and suppressed errors, rerun with: -s
==37873== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0)

[patrick-stephens]

I think you missed updating the workflow that actually builds the containers for the target:

fluent-bit/.github/workflows/call-build-images.yaml

Lines 80 to 92 in 96a88df

	call-build-single-arch-container-images:
	# Allow us to continue to create a manifest if we want
	continue-on-error: true
	permissions:
	contents: read
	packages: write
	strategy:
	fail-fast: false
	matrix:
	platform:
	- amd64
	- arm64
	- arm/v7

It also looks like some Monkey changes which I think need to go via the upstream project @leonardo-albertovich ?

[sumitd2]

@patrick-stephens The (new) custom_calyptia.sh test is crashing after appearing hanged for a few minutes. Is there something I am missing, or do I need to debug it?

[patrick-stephens]

@patrick-stephens The (new) custom_calyptia.sh test is crashing after appearing hanged for a few minutes. Is there something I am missing, or do I need to debug it?

The test is this one I think you mean: https://github.com/fluent/fluent-bit/blob/master/tests/runtime_shell/custom_calyptia.sh

It is using YAML config as well so make sure that's enabled but it should be.

If CALYPTIA_FLEET_TOKEN is not set it will skip (or should do) if that's what you mean.

[sumitd2]

@patrick-stephens The (new) custom_calyptia.sh test is crashing after appearing hanged for a few minutes. Is there something I am missing, or do I need to debug it?

The test is this one I think you mean: https://github.com/fluent/fluent-bit/blob/master/tests/runtime_shell/custom_calyptia.sh

It is using YAML config as well so make sure that's enabled but it should be.

If CALYPTIA_FLEET_TOKEN is not set it will skip (or should do) if that's what you mean.

If I set CALYPTIA_FLEET_TOKEN to a random value the test fails, and if I set it to blank the test hangs and eventually crashes. The test passes on an Intel VM.

[sumitd2]

@patrick-stephens This is what the test prints on Intel. Is it expected, or is it a bug:

[root@sdubey-vm fluent-bit]$ export FLB_RUNTIME_SHELL_PATH=/sumit/fluent-bit/tests/runtime_shell
[root@sdubey-vm fluent-bit]$ export FLB_ROOT=/sumit/fluent-bit
[root@sdubey-vm fluent-bit]$ export FLB_RUNTIME_SHELL_CONF=/sumit/fluent-bit/tests/runtime_shell/conf
[root@sdubey-vm fluent-bit]$ export FLB_BIN=/sumit/fluent-bit/build/bin/fluent-bit
[root@sdubey-vm fluent-bit]$ ./tests/runtime_shell/custom_calyptia.sh

[2025/03/25 03:33:01] [ warn] [env] variable ${CALYPTIA_FLEET_TOKEN} is used but not set
[2025/03/25 03:33:01] [ info] [fluent bit] version=4.0.0, commit=03503618f8, pid=19486
[2025/03/25 03:33:01] [ info] [custom:calyptia:calyptia.0] generated UUID for machine ID: a59d2a40-fb43-4e26-8902-4cd498b36478
[2025/03/25 03:33:01] [ info] [custom:calyptia:calyptia.0] written machine ID to file: /tmp/fleet-test/machine-id.conf
[2025/03/25 03:33:01] [ info] [custom:calyptia:calyptia.0] read UUID (a59d2a40-fb43-4e26-8902-4cd498b36478) from file: /tmp/fleet-test/machine-id.conf
[2025/03/25 03:33:01] [ info] [custom:calyptia:calyptia.0] custom initialized!
[2025/03/25 03:33:01] [ info] [storage] ver=1.5.2, type=memory, sync=normal, checksum=off, max_chunks_up=128
[2025/03/25 03:33:01] [ info] [simd    ] disabled
[2025/03/25 03:33:01] [ info] [cmetrics] version=0.9.9
[2025/03/25 03:33:01] [ info] [ctraces ] version=0.6.1
[2025/03/25 03:33:01] [ info] [input:random:random.0] initializing
[2025/03/25 03:33:01] [ info] [input:random:random.0] storage_strategy='memory' (memory only)
[2025/03/25 03:33:01] [ info] [input:fluentbit_metrics:fluentbit_metrics.1] initializing
[2025/03/25 03:33:01] [ info] [input:fluentbit_metrics:fluentbit_metrics.1] storage_strategy='memory' (memory only)
[2025/03/25 03:33:01] [ info] [input:calyptia_fleet:calyptia_fleet.2] initializing
[2025/03/25 03:33:01] [ info] [input:calyptia_fleet:calyptia_fleet.2] storage_strategy='memory' (memory only)
[2025/03/25 03:33:01] [ info] [input:calyptia_fleet:calyptia_fleet.2] initializing calyptia fleet input.
[2025/03/25 03:33:01] [ info] [input:calyptia_fleet:calyptia_fleet.2] invalid interval settings, using defaults: sec=15 nsec=0
[2025/03/25 03:33:01] [ warn] [read_glob] glob: [/tmp/fleet-test/28aff026c3572db5313a0aa9839531a80a900413b55ae6dc601bb9970309746d/fluent-bit-ci-fleet/*.conf] no match
[2025/03/25 03:33:01] [error] [input:calyptia_fleet:calyptia_fleet.2] unable to read fleet directory for config files: /tmp/fleet-test/28aff026c3572db5313a0aa9839531a80a900413b55ae6dc601bb9970309746d/fluent-bit-ci-fleet/*.conf
[2025/03/25 03:33:01] [ warn] [input:calyptia_fleet:calyptia_fleet.2] unable to find latest configuration file
[2025/03/25 03:33:01] [ info] [input:calyptia_fleet:calyptia_fleet.2] fleet collector initialized with interval: 15 sec 0 nsec
[2025/03/25 03:33:01] [ info] [sp] stream processor started
[2025/03/25 03:33:01] [ info] [output:null:null.0] worker #0 started
[2025/03/25 03:33:16] [engine] caught signal (SIGSEGV)
#0  0x7f2ed5040afc      in  ???() at ???:0
#1  0x7eeb99            in  get_project_id_from_api_key() at plugins/in_calyptia_fleet/in_calyptia_fleet.c:827
#2  0x7ef225            in  get_calyptia_fleet_id_by_name() at plugins/in_calyptia_fleet/in_calyptia_fleet.c:922
#3  0x7f15bc            in  in_calyptia_fleet_collect() at plugins/in_calyptia_fleet/in_calyptia_fleet.c:1876
#4  0x4c4833            in  input_pre_cb_collect() at include/fluent-bit/flb_input.h:592
#5  0x14b8ea6           in  co_init() at lib/monkey/deps/flb_libco/amd64.c:117
#6  0xffffffffffffffff  in  ???() at ???:0
./tests/runtime_shell/custom_calyptia.sh: line 33: 19486 Aborted                 (core dumped) $FLB_BIN -c "$FLB_RUNTIME_SHELL_CONF/custom_calyptia_fleet.conf"
No YAML files found
./tests/runtime_shell/custom_calyptia.sh: line 60: kill: (19486) - No such process
Ran 2 tests.
OK (skipped=1)

[patrick-stephens]

It looks like it is not skipping it for some reason when the variable is not set, or have you set it to the empty value?

[sumitd2]

[2025/03/25 03:33:01] [ warn] [env] variable ${CALYPTIA_FLEET_TOKEN} is used but not set

[github-actions]

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.