Support Sagemaker as chat_models so it can be used for tool calling efficiently #7252
khanzzirfan
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Checked
Feature request
Sagemaker hosted models such as (Llama3.1, Mistral, ) all support tool calling. but the lang chain module sagemaker class, doesn't understand correctly the response from AI for tool calling because langchain->sagemaker is missing bind_tools functionality.
Although I created createAiToolAgent, createReActAgent, both are not helpful. doesn't work. I tested my theory with same llama3.1 model hosted on Ollama and ChatOllama works in tool calling. but sagemaker same model doesn't work .
Motivation
I spend a week in understanding langgrah and tool calling. but then realised Sagemaker hosted models are not working LangChain/Langraph. There should be a effiecient chat model for sagemaker to bind tools and interact with AI correctly.
This request is same as bedrock chatmodel request created here. #2744
Proposal (If applicable)
Please following the same pattern for bedrock chat model, there should be a similar sagemaker model too.
#2744
#2746
Beta Was this translation helpful? Give feedback.
All reactions