-
-
Notifications
You must be signed in to change notification settings - Fork 999
Allow MD_JSON for bedrock client #2076
Copy link
Copy link
Open
Labels
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or request
Description
Bedrock models such as Kimi K2 Thinking usually return ... tags which precedes the actual JSON data. Currently instructor retries and eventually the model returns the JSON only.
It would be great if we could use MD_JSON or custom processors to handle removing such tags.
Additional context
Using version = "1.14.5"
I did notice in the documentation that BEDROCK_JSON is legacy and replaced by MD_JSON but I still don't find doc to replace it in code or find a solution to the problem I have described
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or request