implement a Rust version of the API

[linkedlist771]

Hi, I have also build a similar embeeding project like yours which also provide a OpenAI version embeeding usage. embedding-server-github

But I found the inference speed on Python is not that good, so I want to have a Rust implementation version of it. I wonder weather you guys interested in it.

[linkedlist771]

Also I found the API uses a global model to provide the service, it could make my life easier to have a balancer.

[limcheekin]

@linkedlist771 Thanks for writing. feel free to port it to Rust. My plate is full. For the balancer, I think nginx will get the job done, right?