Orchestrator sends lengthy input to tool causing json.decoder.JSONDecodeError

[haolx]

Hi community,

I have been playing with orchestrator with function calling type agentic workflow. There are cases where orchestrator needs to send lengthy input to a given tool, and that causes Json decoding issue. My understanding is when orchestrator is doing function calling, it's basically generating a json which includes what tool to call and what inputs to the tool. When it comes to lengthy input (e.g., user might send a lengthy code to orchestrator asking for explanation or correction, and it passes it to a coding agent), the input could be missing " or } in the end etc., causing the error - json.decoder.JSONDecodeError: Unterminated string starting at.

Any suggestion please?

Thanks.