[Question]: How to configure LibreChat to connect to company's AI model gateway. #5169
Unanswered
JIPINGBABA
asked this question in
Q&A
Replies: 2 comments
-
you can either create a custom endpoint, or use it via OpenAI:
|
Beta Was this translation helpful? Give feedback.
0 replies
-
Successfully connected, thank you very much,have a nice day! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What is your question?
I want to use LibreChat to connect to the AI model developed by my company. When I use a Python script, the connection works correctly. How should I configure and modify it to adapt to the model?
Thanks so much.
curl -X 'POST' \ 'https://ai-gateway.company-name.io/v1/chat/completions' \ -H 'accept: application/json' \ -H 'Authorization: Bearer {api-key}' \ -H 'Content-Type: application/json' \ -d '{ "messages": [ { "role": "user", "content": "how are you ?" } ], "model": "anthropic.claude-v2:1", "frequency_penalty": 0, "presence_penalty": 0, "stream": false, "stream_options": { "include_usage": true }, "temperature": 1, "top_p": 1, "user": "string", "max_tokens": 2048 }'
More Details
messages = [{ "content": question,"role": "user"}]
What is the main subject of your question?
No response
Screenshots
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions