Skip to content

Releases: callbacked/keyless-gpt-wrapper-api

Added o3-mini Support + Update to llama 3.3

12 Feb 17:55
2ccdd13

Choose a tag to compare

DuckDuckGo Chat has recently added a new model to its website, o3-mini. Additionally, they no longer are using llama3.1 and have updated their model to use llama3.3, despite their 3.1 endpoint still being up (Thank you @realgorlix for pointing this out!). This mini release is to add support for these new models.

Screenshot 2025-02-12 at 1 41 26 PM

Screenshot 2025-02-12 at 1 36 59 PM

Screenshot 2025-02-12 at 1 39 27 PM

Docker Image has been updated, you can find it here on Docker Hub.

Speech API Endpoints + Reintroduced Bug Fix

20 Nov 07:40
cef26d5

Choose a tag to compare

Notes

  1. Added audio generation endpoints, which is based on the OpenAI Speech API . It uses TikTok's Text-To-Speech to provide the voices (there's a ton to use). This is useful for those who run their own Web UI's for LLMs and would like to have their messages read to them. Or perhaps you are a developer who is making/prototyping a voice-based assistant but you do not want to pay for speech generation APIs during development.

The speech API can either be used alongside the /completions endpoint (to "hear" your LLM's responses) or it can be used independently so you can generate speech based on your own input text, again mimicking how OpenAI does it for compatibility. Refer to the website to see the sample API calls.

  • /v1/audio/speech/
  • /v1/audio/speech/voices

If you are interested in what voices you can use you can take a look here

Here is a demo of it in action

Screen.Recording.2024-11-20.at.2.37.22.AM.mov

These endpoints are completely optional are not functional without setting a session_id as outlined in the Wiki

  1. The partial-context bug that was supposed to ship with Version 1.0.0, is now shipped to this current version. I had made the mistake of not applying the bug fix to the branch I was working on at the time. But all is well now.

  2. A Wiki has been made for setup instructions, so it declutters the main README file.

  3. The website has been updated for this release, check it out

Feel free to pull the latest updated Docker image from callbacked/keyless:latest

Remote Docker Image + Bug Fix + Responsiveness Improvement

11 Nov 06:01

Choose a tag to compare

Notes