Skip to content

out_opentelemetry: add gzip and zstd compression for grpc#9820

Open
flobz wants to merge 2 commits intofluent:masterfrom
flobz:feature/add_gzip_compression
Open

out_opentelemetry: add gzip and zstd compression for grpc#9820
flobz wants to merge 2 commits intofluent:masterfrom
flobz:feature/add_gzip_compression

Conversation

@flobz
Copy link
Contributor

@flobz flobz commented Jan 10, 2025

Add gzip compression for otlp grpc output.


Testing
Before we can approve your change; please submit the following in a comment:

  • [N/A] Example configuration file for the change
  • [N/A] Debug log output from testing the change
  • Attached Valgrind output that shows no leaks or memory corruption was found

Documentation

  • [N/A] Documentation required for this feature

Backporting

  • [N/A] Backport to latest stable release.

Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.

@flobz flobz force-pushed the feature/add_gzip_compression branch from f69f7d9 to a4ac39d Compare January 10, 2025 10:08
@flobz flobz changed the title Add gzip compression for otlp grpc out_opentelemetry: add gzip compression for grpc Jan 10, 2025
@flobz
Copy link
Contributor Author

flobz commented Jan 10, 2025

Fluent config:

[SERVICE]
    Flush     1
    Daemon    off
    Log_Level debug


[INPUT]
    Name                 node_exporter_metrics
    Tag                  system_metrics
    Scrape_interval      10

[OUTPUT]
    Name                 opentelemetry
    Match                *
    Host                 127.0.0.1
    Port                 4317
    grpc                 true
    http2               force
    Log_response_payload True
    Tls                   Off
   Compress       gzip

Open telemetry collector config:

receivers:
  otlp:
    protocols:
     grpc:
        endpoint: 0.0.0.0:4317
       
exporters:
      debug:
        verbosity: detailed
service:
  pipelines:
    metrics:
        receivers: [otlp]
        exporters: [debug]
  telemetry:
    logs:
     level: debug
     development: true

Valgrind report:

==4060852== 
==4060852== HEAP SUMMARY:
==4060852==     in use at exit: 0 bytes in 0 blocks
==4060852==   total heap usage: 45,211 allocs, 45,211 frees, 32,868,495 bytes allocated
==4060852== 
==4060852== All heap blocks were freed -- no leaks are possible
==4060852== 
==4060852== For lists of detected and suppressed errors, rerun with: -s

Signed-off-by: Florian Bezannier <florian.bezannier@hotmail.fr>
@flobz flobz force-pushed the feature/add_gzip_compression branch from 2381031 to 7f33b8e Compare May 20, 2025 12:30
@flobz flobz changed the title out_opentelemetry: add gzip compression for grpc out_opentelemetry: add gzip & zstd compression for grpc May 20, 2025
Signed-off-by: Florian Bezannier <florian.bezannier@hotmail.fr>
@flobz flobz force-pushed the feature/add_gzip_compression branch from 7f33b8e to 6bc2a2c Compare May 20, 2025 14:54
@flobz flobz changed the title out_opentelemetry: add gzip & zstd compression for grpc out_opentelemetry: add gzip and zstd compression for grpc May 20, 2025
@flobz
Copy link
Contributor Author

flobz commented Aug 18, 2025

@leonardo-albertovich can you review this PR ?

@github-actions
Copy link
Contributor

This PR is stale because it has been open 45 days with no activity. Remove stale label or comment or this will be closed in 10 days.

@github-actions github-actions bot added the Stale label Nov 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant