docs, CompressingChatMemoryStore, SystemMessage w/ compressed summary is always dropped

[bitsofinfo]

Hi,
Trying to work w/ the example here: https://docs.quarkiverse.io/quarkus-langchain4j/dev/guide-semantic-compression.html

The CompressingChatMemoryStore, the behavior I'm seeing instead of what is described is every time the messages get compressed and appended onto the 1st SystemMessage.... the DefaultCommittableChatMemory calls clear() on the delegate which is MessageWindowChatMemory which then calls store.deleteMessages() which ultimately just wipes the "compressed system message" that contains the context data appended. It just gets replaced by a new clean "SystemMessage" from the annotation on the service or method being called.

[bitsofinfo]

actually looks to be AIServiceMethodImplementationSupport.createMessagesToSendForExistingMemory which calls DefaultCommittableChatMemory.add(defaultSystemMessage) and the impl of DefaultCommittableChatMemory.add removes any pre-existing SystemMessage and replaces it w/ the default one, which ends up smoking the "compressed system message" and inserting the default one at position 0.

quarkus-langchain4j/core/runtime/src/main/java/io/quarkiverse/langchain4j/runtime/aiservice/DefaultCommittableChatMemory.java

Line 34 in 1a53136

newMessages.remove(systemMessage.get()); // need to replace existing system message

[bitsofinfo]

Also this findAny() here.... what if there are multiple system messages being managed in the application? this just grabs a random one.... when I assume the intent is to grab the first no?

quarkus-langchain4j/core/runtime/src/main/java/io/quarkiverse/langchain4j/runtime/aiservice/DefaultCommittableChatMemory.java

Line 43 in 1a53136

private static Optional<SystemMessage> findSystemMessage(List<ChatMessage> messages) {

[geoand]

Thanks for reporting!

As it's hard to follow exactly what the situation is here, is there any chance you can put together some small example project that I can use to see this in action?