Skip to content

Conversation

@jee14
Copy link
Contributor

@jee14 jee14 commented Nov 10, 2024

Hello,

I have added a Solar model client. Solar is an LLM and embedding model from Upstage, a company based in South Korea, and is especially optimized for Korean and Japanese embeddings.

Links

If needed, I can provide my API key for your use.

@markpollack
Copy link
Member

Hi. Is this model have openai API compatability? That would be a preferred direction to ease with maintenance.

@jsilverman26
Copy link
Contributor

jsilverman26 commented Nov 13, 2024

@jee14 @markpollack Hi, Solar model has OpenAI API compatibility.
check this.
Upstage API Documentation

from openai import OpenAI # openai==1.52.2
 
client = OpenAI(
    api_key="UPSTAGE_API_KEY",
    base_url="https://api.upstage.ai/v1/solar"
)

@jee14
Copy link
Contributor Author

jee14 commented Nov 14, 2024

Hi. Is this model have openai API compatability? That would be a preferred direction to ease with maintenance.

Yes. Please refer to @jsilverman26 comment.
There are a lot of features that need to be added to this PR (e.g. streaming), but I think more people can participate in the contribution to this model if it merges.

@jee14 jee14 closed this by deleting the head repository Dec 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants