OpenAI compatible provider

[greggh]

I use GPUStack on my local network to do inference. It gives me an OpenAI compatible server. I don't see in the documentation for mycoder a way to choose openai as my provider, but set a custom url for the server. Is this implemented yet?

[bhouston]

This is not implemented but it is a good idea. I think that would also support grok/xai. I will schedule it.

[bhouston]

I've implemented it on main. You can actually specify gpustack as a provider and then set the "baseUrl" in the config file. I'll add docs and release this tomorrow.