The Correct Cohere Base URL

[febryanvaldo]

Hello there,

Right now the Base URL that librechat uses for Cohere (Custom Endpoints) is https://api.cohere.ai/v1, and it's working perfectly fine on my end.

But in their official documentation, the Base URL that should be used is either https://api.cohere.com/v1 (legacy) or https://api.cohere.com/v2 (new one). If you look closely, there is a slight difference in the domain, LibreChat uses .ai, while official docs uses .com.

When i try to use either https://api.cohere.com/v1 or https://api.cohere.com/v2 for the Base URL baseURL: https://api.cohere.com/v2 in librechat.yaml, it cannot, it gave me error.

But when i try to CURL or use python script to get the list of available models https://api.cohere.com/v2/models, it working fine. It's kinda weird. What do you think about this situation?

[febryanvaldo]

Got an update from the Cohere team.

[busla]

Would be great if the base url could also respect an env variable for overriding with a custom service.

It would comply with other base url overriding conventions in the repo.

• _BASE_URL
• CUSTOM__URL

[busla]

@danny-avila I can create a PR, is that something you would consider looking at?

[danny-avila]

Thanks, feel free to submit a PR

[busla]

libre: #9544
docs: https://github.com/LibreChat-AI/librechat.ai/pull/409/files

[busla]

I am not sure what formatting script is currently used in the librechat.ai. Both prettier and lint:prettier taint 250 files