Skip to content

Conversation

xxxx3
Copy link

@xxxx3 xxxx3 commented May 16, 2025

add aws bedrock prompt-caching support.
aws url:https://docs.aws.amazon.com/bedrock/latest/userguide/prompt-caching.html

@markpollack markpollack added this to the 1.1.x milestone May 17, 2025
@DEG-7
Copy link

DEG-7 commented May 30, 2025

Hey @xxxx3, could you also add the cachePoint in the tools definition as it's shown in the same AWS documentation page you shared?
Great work and thank in advance !!

...
toolConfig={
    "tools": [
        {
            "toolSpec": {
                "name": "top_song",
                "description": "Get the most popular song played on a radio station.",
                "inputSchema": {
                    "json": {
                        "type": "object",
                        "properties": {
                            "sign": {
                                "type": "string",
                                "description": "The call sign for the radio station for which you want the most popular song. Example calls signs are WZPZ and WKRP."
                            }
                        },
                        "required": [
                            "sign"
                        ]
                    }
                }
            }
        },
        {
                "cachePoint": {
                    "type": "default"
                }
        }
    ]
}
...

@gpalacios-caylent
Copy link

Oh! This will be a great addition

@markpollack markpollack added the enhancement New feature or request label Jul 11, 2025
@markpollack markpollack modified the milestones: 1.1.0.M1, 1.1.0.M3 Sep 19, 2025
@markpollack markpollack modified the milestones: 1.1.0.M3, 1.1.0.M4 Oct 20, 2025
@sobychacko
Copy link
Contributor

Thanks for the PR. As part of adding prompt caching support in Spring AI as a feature from other models, we just revamped the AWS bedrock prompt caching support via another PR. #4614. Closing this PR.

@sobychacko sobychacko closed this Oct 20, 2025
@sobychacko sobychacko removed this from the 1.1.0.M4 milestone Oct 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Bedrock enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants