Changed "Local Server" to "Custom Server" #230
machinewrapped
announced in
Announcements
Replies: 1 comment
-
Note: if you are using a custom server from the command line and set up configuration values in a .env file, you will need to replace LOCAL_ with CUSTOM_ in the parameter names after updating to latest. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Renamed "Local Server" provider to "Custom Server" - it was never a requirement that the server be local, so this makes it clearer that the provider can be used with any OpenAI-compatible API.
Added a max_completion_tokens option for Custom Server, since OpenAI are no longer accepting max_tokens for some of their own models. You should probably set one or the other or neither, not both.
Plus several arguably more important fixes for non-Windows platforms:
Removed boto3 from the packaged build to reduce the size - Bedrock is pretty niche, and if you can handle setting up AWS then you can definitely handle installing gpt-subtrans from source!
This discussion was created from the release Changed "Local Server" to "Custom Server".
Beta Was this translation helpful? Give feedback.
All reactions