The NeMo Agent toolkit Memory subsystem is designed to store and retrieve a user's conversation history, preferences, and other "long-term memory." This is especially useful for building stateful LLM-based applications that recall user-specific data or interactions across multiple steps.
The memory module is designed to be extensible, allowing developers to create custom memory back-ends, providers in NeMo Agent toolkit terminology.
The NeMo Agent toolkit includes three memory module providers, all of which are available as plugins:
- Mem0 which is provided by the
nvidia-nat-mem0aiplugin. - Redis which is provided by the
nvidia-nat-redisplugin. - Zep which is provided by the
nvidia-nat-zep-cloudplugin.
The following examples demonstrate how to use the memory module in the NeMo Agent toolkit:
examples/memory/redisexamples/frameworks/semantic_kernel_demoexamples/RAG/simple_rag
For information on how to write a new memory module provider can be found in the Adding a Memory Provider document.