Add next edit prediction for autocomplete

[johnnyasantoss]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

Hello,

I would like to request a feature. I want to use the same model as Zed does, Zeta 1, to predict next edits. I know this is different than fill-in-the-middle autocomplete, but maybe adding a different type of autocomplete or a type to the autocomplete model in the config to know which prompt to send to the model.

The model is open source and can be found on Ollama 2 and Huggingface 3

Solution

I don't really have a solution as I'm not really familiar with this codebase. But generally speaking, a new type of prompt needs to be sent and parsed to this "new" (?) type of model.

[Tear4Pixelation]

I second this. Zed's edit predictions feature is such a game changer! Zeta is also an excellent completion model.

[vaakian]

seems #5921 did it

[pai4451]

seems #5921 did it

It seems that it's not ready, is there any roadmap on this feature? @jpoly1219

[TyDunn]

@pai4451 More publicly available and open weights models capable of Next Edit are beginning to emerge, so we are exploring this now and will have more to share soon 🚀

[Tear4Pixelation]

@TyDunn Thanks for the info and I'm looking forward to it! I think the best current model is Zeta, the thing is its not on ollama but I can see that changing as there are ggufs of it. Funnily you would be better than zed themselves as they don't allow self running the model (please do).
Very excited!

[pai4451]

@TyDunn Thank you. I am really looking forward to and wish Continue can bring a smooth UI like WindSurf or Zed Editor. I know there are some limitations in the UI design for VS Code extensions, but I hope we can see a great next edit UX from Continue.

[DustyPullRequest]

Any news? Last post was 2 months ago.

[TyDunn]

@DustyPullRequest @pai4451 @Tear4Pixelation @vaakian @johnnyasantoss Yes! Y'all can now try the Next Edit beta feature in VS Code: https://docs.continue.dev/features/autocomplete/next-edit

More to come in the next couple weeks too :)

[Tear4Pixelation]

@TyDunn Wow, great job! What are the plans for jetbrains support and local model support?

[TyDunn]

@Tear4Pixelation Exciting local model updates coming! It's possible to use local models today but the currently available open models are not quite good enough

We are in the process of understanding the feasibility of JetBrains atm