Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

out_opentelemetry: add gzip compression for grpc #9820

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

flobz
Copy link
Contributor

@flobz flobz commented Jan 10, 2025

Add gzip compression for otlp grpc output.


Testing
Before we can approve your change; please submit the following in a comment:

  • [N/A] Example configuration file for the change
  • [N/A] Debug log output from testing the change
  • Attached Valgrind output that shows no leaks or memory corruption was found

Documentation

  • [N/A] Documentation required for this feature

Backporting

  • [N/A] Backport to latest stable release.

Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.

@flobz flobz force-pushed the feature/add_gzip_compression branch from f69f7d9 to a4ac39d Compare January 10, 2025 10:08
@flobz flobz changed the title Add gzip compression for otlp grpc out_opentelemetry: add gzip compression for grpc Jan 10, 2025
@flobz
Copy link
Contributor Author

flobz commented Jan 10, 2025

Fluent config:

[SERVICE]
    Flush     1
    Daemon    off
    Log_Level debug


[INPUT]
    Name                 node_exporter_metrics
    Tag                  system_metrics
    Scrape_interval      10

[OUTPUT]
    Name                 opentelemetry
    Match                *
    Host                 127.0.0.1
    Port                 4317
    grpc                 true
    http2               force
    Log_response_payload True
    Tls                   Off
   Compress       gzip

Open telemetry collector config:

receivers:
  otlp:
    protocols:
     grpc:
        endpoint: 0.0.0.0:4317
       
exporters:
      debug:
        verbosity: detailed
service:
  pipelines:
    metrics:
        receivers: [otlp]
        exporters: [debug]
  telemetry:
    logs:
     level: debug
     development: true

Valgrind report:

==4060852== 
==4060852== HEAP SUMMARY:
==4060852==     in use at exit: 0 bytes in 0 blocks
==4060852==   total heap usage: 45,211 allocs, 45,211 frees, 32,868,495 bytes allocated
==4060852== 
==4060852== All heap blocks were freed -- no leaks are possible
==4060852== 
==4060852== For lists of detected and suppressed errors, rerun with: -s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant