Skip to content

Conversation

@dgageot
Copy link
Member

@dgageot dgageot commented Jan 15, 2026

  • Cut the message that contained the date, env, agents.md and skills into separate system messages
  • Reordered the system messages to have the most invariant messages first
  • Instead of caching the first two system messages and the last two user/assistant messages, we mark the tool instructions with a cache control checkpoint because it's the last system message before the ones that can be more user specific
  • We mark the last system message too.
  • We keep on marking the last user/assistant messages with the cache control flag.

Added a few tests and e2e on the way.

@dgageot dgageot requested a review from a team as a code owner January 15, 2026 16:24
@dgageot
Copy link
Member Author

dgageot commented Jan 15, 2026

/review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants