generated from runpod-workers/worker-template
-
Notifications
You must be signed in to change notification settings - Fork 267
Open
Description
There is environment variable OPENAI_SERVED_MODEL_NAME_OVERRIDE that is used to change loaded model name. I have tested this option and found out that it does work only for version 0.6.1 while 0.6.2 does not change model name and 0.6.3 and 0.6.4 can not even start the inference server
I have to use older version which kind of less efficient in order to be able to use custom model name and incapsulate organization and model name to some common persistent name for ease for integration. This is really annoying hope you can figure out way to correct that bug it basically blocks users who need custom model name from using the most fresh versions of inference server
tristanryerparke
Metadata
Metadata
Assignees
Labels
No labels