Connection VSC/Continue/LMStudio Lokal AI

[SundanceOwl]

Hello, it seems i have problems initialising my AI connection to a locally running server in LMStudio. It is said that i dont need an OPENAI-API Key for connection (i dont have any, because it should be local and i dont want cost from OpenAI) so i leave that key free in the settings. But without that, i cant choose my local running AI from the list to select in the chatwindow.

When i provide a "fake" key (i do that in that config.yaml)i can reach the running AI from LMStudio in the chatwindow, but when i enter a question in the chatwindow, it always say

401 You didn't provide an API key. You need to provide your API key in an Authorization header using Bearer auth (i.e. Authorization: Bearer YOUR_KEY), or as the password field (with blank username) if you're accessing the API from your browser and are prompted for a username and password. You can obtain an API key from https://platform.openai.com/account/api-keys.

So what should i do to connect to the running AI in LMStudio? It didnt worked out for me yet.
I suppose something like a strange handshaking problem with that key. What is the correct setting to connect to a locally running AI?

Thanks for helping

[bdougie]

You don't need to add a key and should remove it, but please provide more context your config. Without seeing that I can only guess at what the solution is. Also consider using the docs to triage.

https://docs.continue.dev/reference

[SundanceOwl]

my yaml config.yaml looks like this:

name: LMStudio Local
version: 1.0.0
schema: v1
models:

• name: Deepseek via LMStudio
  provider: openai
  apiBase: http://localhost:1234/v1
  apiKey: lmstudio
  model: deepseek-coder
  isDefault: true

i have tried different approaches to contact lmstudio with continue, to avoid those nasty paywalls in the cloud. but i wasnt capable to find a working solution for LMStudio (lokal) to connect. although the installation of LMStudio was correct. Actually i found a solution with ollama with a working config.yaml.