Skip to content

update fluent-bit page to include prometheus scrape input #64

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

update fluent-bit page to include prometheus scrape input #64

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 40 additions & 0 deletions content/docs/datasource/log-agents/fluent-bit.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -427,3 +427,43 @@ Why use a parser?
- Extracts structured fields from JSON logs.
- Converts timestamps into a standard format.

### Ingesting Prometheus Metrics in Parseable
Fluent Bit can also be used to collect logs and metrics from a Prometheus-based endpoint into Parseable. This is useful for monitoring and alerting purposes. You can use the [Prometheus scrape Metrics Input plugin](https://docs.fluentbit.io/manual/data-pipeline/inputs/prometheus-scrape-metrics) to scrape metrics from Prometheus endpoints and send them to Parseable using the [OpenTelemetry Output plugin](https://docs.fluentbit.io/manual/data-pipeline/outputs/opentelemetry).
The opentelemetry output plugin allows you to submit Logs, Metrics, or Traces to Parseable's OpenTelemetry endpoint using the OpenTelemetry Protocol (OTLP).
Here is an example configuration to scrape metrics from a Prometheus endpoint and send them to Parseable:

```ini
[SERVICE]
Flush 1
Log_level info
Daemon Off

[INPUT]
Name prometheus_scrape
Tag parseable.demo.metrics
Host demo.parseable.com
Port 443
Tls On
Tls.Verify Off
Metrics_path /api/v1/metrics
Http_User admin
Http_Passwd admin
Scrape_interval 10

[OUTPUT]
Name opentelemetry
Match parseable.demo.metrics
Host 13.217.53.213
Port 8010
Metrics_uri /v1/metrics
Log_response_payload True
Tls Off
Http_User admin
Http_Passwd admin
Header X-P-Stream parseablemetrics
Header X-P-Log-Source otel-metrics
add_label app fluent-bit
add_label source_host demo.parseable.com
add_label environment demo

This example configuration scrapes metrics from a Prometheus endpoint and sends them to another Parseable endpoint using the OpenTelemetry output plugin.