Skip to content

Sync jobs metrics not being outputed #70917

@DFurt

Description

@DFurt

Helm Chart Version

1.8.5

What step the error happened?

During the Sync

Relevant information

Trying to get sync metrics to be output to open telemetry endpoint.

Tried this solution:

https://docs.airbyte.com/platform/operator-guides/open-telemetry

With this, the OTEL_COLLECTOR_ENDPOINT in the configmap is populated with the otel endpoint but the metrics are not shared to the grafana I'm using, probably due to being a paid feature:

global:
    edition: enterprise # This is an enterprise-only feature
    metrics:
        enabled: true
        otlp:
            enabled: true
            # The OpenTelemetry Collector endpoint Airbyte sends metrics to. You configure this endpoint outside of Airbyte as part of your OpenTelemetry deployment
            # This endpoint also needs to end in the metrics ingestion endpoint. For OpenTelemetry Collector users, this is /v1/metrics.
            # e.g. http://localhost:4318/v1/metrics
            collectorEndpoint: "YOUR_ENDPOINT" 

Tried other ways, like setting these variables directly to the worker pod and as a global.env_vars but these also didn't being the expected outcome.

Is there a way to make this work? Using OSS version deployed with helm in v1.32.8-gke.1108000

Relevant log output

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions