Ollama integration?

[mars-s]

surely we can get a local method of running this with https://github.com/jmorganca/ollama

[TheR1D]

It is possible to run other LLMs locally using LocalAI or other OpenAI compatible local backends. In the config file we can point sgpt requests to localhost by changing OPENAI_BASE_URL.