Skip to content

0.0.91 - Support for Streaming and System Prompt

Latest
Latest

Choose a tag to compare

View all tags
@bearlike bearlike released this 01 Apr 09:15
· 2 commits to main since this release
0.0.91
ec5991c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Packages

What's Changed

  • Implement real streaming support in chat completions. #2
  • Optimized for LM chat interfaces (like OpenWebUI) to render as reasoning tokens. #2
  • Support for user provided system prompt. #2
  • Improve API documentation #2

Full Changelog: 0.0.9...0.0.91

image

Reasoning effort set to high with GPT-4o-mini

Assets 2
Loading