refactor(memory): Improve Chat Memory logic and efficiency

[juntae6942]

Title:
Refactor(memory): Improve logic and efficiency of Chat Memory

Body:
Closes: #3945

This pull request addresses the performance overhead in MessageWindowChatMemory by refactoring its internal logic and abstracting the storage layer. The previous implementation replaced the entire message list on every update, which is inefficient for long-running conversations.

Key Changes
Introduced ChatMemoryRepository: A new interface is introduced to abstract the storage mechanism, decoupling the chat memory logic from the in-memory implementation. This design allows for future persistent implementations (e.g., Redis, JDBC).

Efficient InMemoryChatMemoryRepository: The default InMemoryChatMemoryRepository now uses an efficient refresh method to apply only deltas (additions/deletions) instead of replacing the entire list, significantly reducing overhead.

Updated MessageWindowChatMemory: The class is refactored to use the new ChatMemoryRepository, delegating all state mutations to the repository layer.

Updated Tests: Comprehensive unit tests have been added and updated to ensure the reliability and correctness of the new implementation.

[YunKuiLu]

This might need some discussion. Some NoSQL databases (like MongoDB?) only support full message overwrite and do not support incremental updates or deletions.

And after ChatMemoryRepository added new methods, spring-ai-model-chat-memory-repository-jdbc, spring-ai-model-chat-memory-repository-cassandra, spring-ai-model-chat-memory-repository-neo4j should all have corresponding updates and integration tests.

[juntae6942]

@YunKuiLu Thank you for the insightful feedback! Both points you raised are important, and I had them in mind as well.

Regarding the concern for NoSQL databases that only support full overwrites, that is a very valid point. My intention with this PR was to first establish the foundational, more efficient repository pattern with the new interface and the default in-memory implementation. For specific database implementations that don't support incremental updates, we can ensure they rely on a saveAll-style full overwrite to maintain compatibility, while other databases can leverage the benefits of the new refresh method.

I was also fully aware of the need to update the other ChatMemoryRepository implementations (jdbc, cassandra, neo4j). My plan was to first get this core refactoring of the interface and the base implementation merged.

I believed that separating the changes this way would keep the pull requests smaller and more focused, making them easier to review and discuss.

If this approach sounds reasonable to you, I plan to submit follow-up PRs for the other modules once this foundational PR is merged.

Thank you again for the thoughtful review.

[juntae6942]

Hi markpollack,
Thanks for relabeling the PR and running the tests.
Before I consider this completed, I wanted to ask if there are any additional changes or follow-up tasks you’d like me to address.