Skip to content

0.7.0 - Update to vllm 0.8.5 and fix llama guard support

Choose a tag to compare

View all tags
@gkumbhat gkumbhat released this 09 May 20:08
· 51 commits to main since this release
0.7.0
4593165
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Update README with edge case information by @swith004 in #65
  • Remove role_override detector_param support for text/content endpoint for llama guard by @swith004 in #66
  • ⬆️ Update base image and vllm compatibility to 0.8.3-0.8.4 by @evaline-ju in #51
  • ⬆️ Update to allow vllm 0.8.5 by @evaline-ju in #69

Full Changelog: 0.6.1...0.7.0

Contributors

swith004 and evaline-ju
Assets 2
Loading