[Question]: Non-openai format access problems #3078
-
What is your question?I found that claude and other non-OpenAI models used their own company's reference format. What should I do if I am accessing a unified transfer to openai format, but I do not want to add a non-OpenAI model to the openai model list? Thank you for your answer More DetailsI found that claude and other non-OpenAI models used their own company's reference format. What should I do if I am accessing a unified transfer to openai format, but I do not want to add a non-OpenAI model to the openai model list? Thank you for your answer What is the main subject of your question?No response ScreenshotsNo response Code of Conduct
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 5 replies
-
|
Check out the documentation on Custom endpoints, this is the recommended way: |
Beta Was this translation helpful? Give feedback.
-
|
I wanted to implement the request of claude's model to the transfer station in openai format. I modified the configuration of 'endpoint' according to the document instructions. I saw that it said that if I wanted to use existing project icons, I need to define the endpoint name as one of the main endpoints. In this case, I changed the name to anthropic. Oddly enough, when I deploy, the command line prompts me to say that I cannot be one of the default endpoint, which is supposed to be different from what the documentation says. Moreover, when I tried to talk to the anthropic model in the application, I found that he seemed to send a request not to the transfer station I had given, but to the official website of anthropic. I would like to ask where there might be a problem with my configuration, or do I have a wrong understanding of some parts of the document? Thank you for your answer |
Beta Was this translation helpful? Give feedback.
-
|
Try with |
Beta Was this translation helpful? Give feedback.
-
|
Thank you, I found that after changing the name to Claude and then adding Claude in.env, I can select Claude's model when selecting model supplier, but I found that there seems to be a problem with the picture of the model. According to the document, I changed the iconURL to anthropic or the url of a picture, but the icon of the model will not be displayed correctly. I would like to ask what the problem is, thank you for your answer |
Beta Was this translation helpful? Give feedback.
-
|
The image issue was fixed in the 2024.6.26 update |
Beta Was this translation helpful? Give feedback.
-
|
is there a way to add icons to the assets folder and use the folder path in the iconURL? im trying to inlcude nvidia endpoints and i need nvidia icon for it |
Beta Was this translation helpful? Give feedback.
The image issue was fixed in the 2024.6.26 update