-
Notifications
You must be signed in to change notification settings - Fork 314
fix: Remove status field from toolResult for non-claude 3 models in Bedrock model provider #686
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
…edrock model provider
…edrock model provider
Note: During my testing, I was able to test with multiple models and I had varying results in comparison with the issue reporter in #554. For example, I was able to get successful tool execution with the
More interestingly, after this change I am seeing the model
I suspect the issue is that Writer Palmyra X4 and X5 have different tool calling implementations in Amazon Bedrock. Palmyra X4 properly supports tool results and can process toolResult blocks with just toolUseId and content fields, while Palmyra X5 appears to have a different tool calling implementation that fails to process tool results entirely, regardless of the field |
I am able to use the status field with |
…Bedrock model provider
…Bedrock model provider
Hey @mehtarac thanks a lot for working on this. Out of curiosity, when did you run these tests with Palmyra X5? We swapped the version of X5 on Bedrock on Friday the 15th at some point. Could you retest if it was on or before that day and see if it changes anything? EDIT: We were able to reproduce the issue on our side and have RCA'd it. There has been a fix provided upstream to AWS. Once AWS updates the container we should be good with this. |
…edrock model provider
…edrock model provider
Hey all, just to update: we've successfully updated Palmyra X5 on Bedrock and are seeing tool calling working as expected. Thank you for the catch on this! We are really hoping to be able to use Palmyra via Bedrock in Strands, so thanks for this. |
Thank you for the fix @samjulien!!! I'll test the model again! |
…edrock model provider
…edrock model provider
Description
Removed the
status
field from thetoolResult
block for non claude-3 models in the Bedrock Model provider. This change is motivated by the linked issue. Furthermore, this change is supported by the bedrock documentation where it explicitly states that thestatus
field is only supported in claude 3 models.Related Issues
#554
Documentation PR
Type of Change
Bug fix
Testing
Script used to test:
hatch run prepare
Checklist
Sources:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.