Skip to content

Local models from the Hub should still work when the continue web service is down #6893

@jeremyfowers

Description

@jeremyfowers

Validations

  • I believe this is a way to improve. I'll try to join the Continue Discord for questions
  • I'm not able to find an open issue that requests the same enhancement

Problem

Sometimes when I am using Continue in vscode the Continue web service goes down, which renders any models and assistants installed from the Continue Hub inoperable. I get 404s, yaml errors, "model not found", etc. until Continue web service is restored.

This is the Hub assistant and models I'm trying to use: https://hub.continue.dev/[lemonade/llamacpp](https://hub.continue.dev/lemonade/llamacpp)

As you can see, they use a local server as the backend and have no dependence on the internet whatsoever.

Solution

The vscode extension could really use some error handling so that local models from the Hub still work if the Hub service is down.

I suggest to simply remember what models were available the last time the Hub service was up, and allow those to be used.

Metadata

Metadata

Assignees

Labels

area:configurationRelates to configuration optionside:vscodeRelates specifically to VS Code extensionkind:enhancementIndicates a new feature request, imrovement, or extension

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions