Issue with Self-Hosted LLM Integration Using vLLM

[AwayahShahid]

Hi,

I’m trying to integrate a self-hosted LLM with the extension, which uses vLLM (supports the OpenAI API standard). I've configured the HTTP endpoint and model name, but I'm unsure where to include the API key.

I tried to add headers to the json settings, but I'm facing the following error when the code completion request is sent:
serde json error: data did not match any variant of untagged enum OpenAIAPIResponse

Could you guide me on the correct approach for passing the API key?

Thanks!

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[codethief]

Duplicate of #144 (though I think the present ticket's title is much better)

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[codethief]

Not stale

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[dgshue]

Anyone figure this one out? I'm passing to my ollama instance through Open WebUI and I can't figure out how to get it to authenticate. I have an API key from my Open WebUI Account, but getting not sure where to pass it into.

[codethief]

@dgshue I ended up switching to the Continue extension – there I have no issues.

[github-actions]

This issue is stale because it has been open for 30 days with no activity.