Local models from the Hub should still work when the continue web service is down #7002
jeremyfowers
started this conversation in
Feedback
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Validations
Problem
Sometimes when I am using Continue in vscode the Continue web service goes down, which renders any models and assistants installed from the Continue Hub inoperable. I get 404s, yaml errors, "model not found", etc. until Continue web service is restored.
This is the Hub assistant and models I'm trying to use: https://hub.continue.dev/[lemonade/llamacpp](https://hub.continue.dev/lemonade/llamacpp)
As you can see, they use a local server as the backend and have no dependence on the internet whatsoever.
Solution
The vscode extension could really use some error handling so that local models from the Hub still work if the Hub service is down.
I suggest to simply remember what models were available the last time the Hub service was up, and allow those to be used.
Beta Was this translation helpful? Give feedback.
All reactions