Skip to content

[Feature] Switch to Ollama native apis #1011

@akshaydeo

Description

@akshaydeo

Discord Thread Context

Thread: Can we support ollama cloud by default? I see that ollama currently doesn't have an option to config
Link: https://discord.com/channels/1371790330269007932/1446498915267514381
Created by: pratham_maxim_91868 (1388047873903562783)

Recent Thread Messages

akshay_deo: <@1388047873903562783> this should be possible using custom provider right?
pratham_maxim_91868: yes
pratham_maxim_91868: <@1305918158963474556> you can create a custom ollama provider here
irichardwang: Yes, that's how I'm doing it now. However, I was looking at the Ollama documentation, and it has its own set of APIs. I thought the Ollama provider was built based on its native API. If it's also usin...
pratham_maxim_91868: yep we do use openai compatible apis right now. so far we havent received any issues regarding it but still creating a ticket

Discord Thread: https://discord.com/channels/1371790330269007932/1446498915267514381

Metadata

Metadata

Assignees

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions