Skip to content

v0.2.0-RC2

Pre-release
Pre-release

Choose a tag to compare

View all tags
@elevran elevran released this 21 Jul 13:30
· 102 commits to main since this release
v0.2.0-rc.2
This tag was signed with the committer’s verified signature.
nirrozenbaum Nir Rozenbaum
GPG key ID: A8C020B008B8FE74
Verified
Learn about vigilant mode.
eabb332
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Image:

ghcr.io/llm-d/llm-d-inference-scheduler:v0.2.0-rc.2

What's Changed

  • bump GIE to v0.5.0-RC3
  • Disable Prefix-Cache-Aware decision, making P/D the default
  • build: change epp-config default manifests` image pull policy
  • Update Prefix-Cache-Scorer cache_tracking mode to use v0.2 KVCache.Indexer

Full Changelog: v0.2.0-RC1...v0.2.0-rc.2

Assets 2
Loading