Deploy with Llama2

[Libresse]

Hi SolidGPT team,

Are there any ways I can deploy your product with Llama2 or any other open source model?

I saw you have Llama manager but didn't find a way to use it.

BR,

[wwwwww1020]

Yes, we are working on using opensource model Llama2 as the LLM core to implement fully local deployment. We will update more about this cool feature in the future. Btw, we will publish our roadmap real soon

[Libresse]

@wwwwww1020 Does the SolidGPT fully support Azure integration, any best practice for that?

[kodiii]

would be great if was possible to use with LM Studio app

[wwwwww1020]

Yes you can easily deploy the project into Azure with Static App , container app and blob storage. We have provide the blob storage client manager let user easily store their data into the blob. We will provide more context about deployment in the further

[wwwwww1020]

would be great if was possible to use with LM Studio app

good idea we will do some research on this

[Libresse]

So are you going to support Chinese LLM like ERNIE in the future?

[wwwwww1020]

So are you going to support Chinese LLM like ERNIE in the future?

Yes we are going to adding more model like ERNIE

[bhupesh-sf]

Hey, did we have any update on LM Studio or anything similar which gives openAI compatible API?