How to implement the logic of bindTools and withStructuredOutput for providers that do not support tool_choice and structured output ? #7502
loss-and-quick
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Problem Description
In my project, users have the flexibility to utilize any custom provider that is compatible with the OpenAI API. However, I have encountered a significant issue: many of these providers do not support
tool_choice
and structured output.This raises a critical question: why doesn't LangChain offer a fallback option that allows for the processing of
tool_choice
and structured output through standard queries?Key Points
tool_choice
and structured output.Inquiry
Is it theoretically feasible to implement a solution that processes
tool_choice
and structured output using standard queries?Beta Was this translation helpful? Give feedback.
All reactions