You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Why does it imply that there is some special connection between Vertex and the enable_json_schema_validation option? Are we not supposed to use it with other providers?
Why does it default to off?
Why does it matter what provider i'm using? Couldn't LiteLLM detect when to turn it on or off?
Does LiteLLM do retries if the schema fails to validate client-side? If so, how many? Does it feed the errors back into the LLM to get the best fix?
Why is it a global variable instead of a completion option?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
I'm reading this: https://docs.litellm.ai/docs/completion/json_mode
I have some questions:
enable_json_schema_validation
option? Are we not supposed to use it with other providers?Beta Was this translation helpful? Give feedback.
All reactions