-
Notifications
You must be signed in to change notification settings - Fork 3.9k
Description
Validations
- I believe this is a way to improve. I'll try to join the Continue Discord for questions
- I'm not able to find an open issue that requests the same enhancement
Problem
Sometimes when I am using Continue in vscode the Continue web service goes down, which renders any models and assistants installed from the Continue Hub inoperable. I get 404s, yaml errors, "model not found", etc. until Continue web service is restored.
This is the Hub assistant and models I'm trying to use: https://hub.continue.dev/[lemonade/llamacpp](https://hub.continue.dev/lemonade/llamacpp)
As you can see, they use a local server as the backend and have no dependence on the internet whatsoever.
Solution
The vscode extension could really use some error handling so that local models from the Hub still work if the Hub service is down.
I suggest to simply remember what models were available the last time the Hub service was up, and allow those to be used.
Metadata
Metadata
Assignees
Labels
Type
Projects
Status