How to debug when evaluations are stalling

[dahnny012]

Describe your question

Recently evaluations started stalling while traffic didnt increase nor was I seeing throttles from bedrock. I checked the logs and nothing was our of the ordinary.

Langfuse Cloud or Self-Hosted?

Self-Hosted

If Self-Hosted

3.148

If Langfuse Cloud

No response

SDK and integration versions

No response

Pre-Submission Checklist

• I have checked for existing issues/discussions and consulted Langfuse AI.

[Steffen911]

@dahnny012 Can you see any error logs within the langfuse worker container? Sometimes, it could mean that your API key is rate-limited and then we schedule messages with an exponential backoff.
Also, does adding more worker containers change the processing rate?

[dahnny012]

Had to restart the worker. Couldnt find the root cause. I had no throttles based on my metrics.