Smart Context Curation

[blankenshipz]

I'm interested in working on a plugin to help users curate the chat context (smart and otherwise) here's some ideas I'm toying with:

• Sometimes I want to keep going in the same style of interaction with some of the conversation history but delete a lot of the context. Maybe all the context between message A and message N for example. There should be a nice UI for this type of simple change to the context. Even taking context as something like a git tree and being able to clone it to new conversations would be a nice future enhancement imo
• Sometimes I want to remove files from my context just by deleting the file from the list in the buffer
• If a READ operation has happened using the files tool it would be nice to have a visible indicator in the buffer that the file is in context now (<read></read>?)
• Rarely do I want to keep an old version of a file in context if I've added a more recent version, this could happen automagically in the background

Future stuff

• Summarization
• Smart clipping
• Context cache swapping (think vectorcode but piecing together context from one or more conversations to send; like stored prompts on steroids - like learning rules based on interactions)

I guess my main question is; does any of this seem like it would be useful and are we aware of any similar community efforts?

I started trying to generate a simple plugin that finds duplicate file context based on submission events but it doesn't seem to actually be able to update the context - it does seem to run on the submission but then we end up in an error state - is this something I should be able to do based on what I've described above? (https://gist.github.com/blankenshipz/66aeff48a1615cb3b7e1f00cca76fddc)

[Davidyz]

I'll shamelessly mention a WIP feature that @ravitemer and I have been working: ravitemer/codecompanion-history.nvim#23

@ravitemer has implemented a nice summarisation module, and with VectorCode, you have the optional memory feature that allows the LLM to search and retrieve previous chat summaries. This sort of does the context swapping because you can just open a fresh new chat and just load the summary of a previous chat. It'd be nice if it could be automatic, and we don't have to open a new chat for this. Imo it's better if we get the summarisation done first, and worry about the context swapping in a future update.

[ravitemer]

Sometimes I want to keep going in the same style of interaction with some of the conversation history but delete a lot of the context. Maybe all the context between message A and message N for example. There should be a nice UI for this type of simple change to the context. Even taking context as something like a git tree and being able to clone it to new conversations would be a nice future enhancement imo

FWIW I have tried to build a very lazygit kind of UI to achieve this long back and couldn't find the time to make it production ready . I am very confident that a UI of this kind will be super useful for everyone. I am thinking of showing a panel with saved chats, ability to duplicate them, maybe send the same message to different models to compare them. I am not confident about the timeline of this though.