Skip to content

Commit 3c2422e

Browse files
Merge pull request #269 from ServiceNow/cache-breakpoint-fix
Fixes issue with anthropic allowing only 4 cache breakpoints per request.
2 parents ecfda97 + 3da541a commit 3c2422e

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

src/agentlab/agents/tool_use_agent/tool_use_agent.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -101,8 +101,10 @@ def flatten(self) -> list[MessageBuilder]:
101101
messages.extend(group.messages)
102102
# Mark all summarized messages for caching
103103
if i == len(self.groups) - keep_last_n_obs:
104-
if not isinstance(messages[i], ToolCalls):
105-
messages[i].mark_all_previous_msg_for_caching()
104+
for msg in messages: # unset previous cache breakpoints
105+
msg._cache_breakpoint = False
106+
# set new cache breakpoint
107+
messages[i].mark_all_previous_msg_for_caching()
106108
return messages
107109

108110
def set_last_summary(self, summary: MessageBuilder):

0 commit comments

Comments
 (0)