Occasionally getting "TypeError: object of type 'NoneType' has no len()" and it seems to be coming from the langfuse OpenAI sdk wrapper

[shaiunterslak]

Any ideas?

[dosubot[bot]]

Hey @shaiunterslak! I'm here to help you with any bugs, questions, or contributions. Let's tackle this together!

A similar issue was previously reported and resolved. The solution involved updating to a newer version of the Langfuse Python SDK, specifically version 2.36.2 ^[1].

The error you're encountering, "TypeError: object of type 'NoneType' has no len()", might be related to how the Langfuse library handles responses from the OpenAI API. A NoneType could be introduced in the content field of the message object within the choices array, which is set to null (equivalent to None in Python) ^[2].

To address this issue, ensure that you are using the latest version of the Langfuse SDK. Additionally, you might want to implement error handling to check for None values in the response content before processing it. This can help prevent the TypeError from occurring.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[marcklingen]

Are you on the latest version of the sdks? Please open a bug report if this happens on the latest python sdk version: langfuse.com/issues

[shaiunterslak]

We finally re-enabled langfuse and got this bug again @marcklingen #6682

[marcklingen]

thanks for sharing, can you add more context to the issue?

[ubernion]

Hello. I have the exact same issue. I think it's related to the length of the prompt?

[ubernion]

Ok so basically langfuse doesnt return errors from the provider (in my case Openrouter) and instead looks for the choices array (which isn't returned in case of error) which is causing the issue @marcklingen

[deveshXm]

@ubernion I'm facing same issue with OpenRouter, were you able to fix it? If yes, how?