SLO Aware Routing Sidecar + Plugin EPP Integration and Helm Deployment#1839

Open

BenjaminBraunDev wants to merge 11 commits intokubernetes-sigs:mainfrom

BenjaminBraunDev:slo-aware-routing-stage-3

Commits on Nov 21, 2025

Add latency predictor plugins, deployment, and runner.go integration
BenjaminBraunDev
committed
Update dockerfile, fix issues with SLO context not being set when prediciton id off
BenjaminBraunDev
committed
Remove outdated inferencepool-resources deployment
BenjaminBraunDev
committed
Fix streamed request being called one final time after request complete, add predictor check to the beginning of each requestcontrol hook
BenjaminBraunDev
committed
add guide, update helm charts and readme, minor scorer changes
BenjaminBraunDev
committed
Make small guide update
BenjaminBraunDev
committed
Add helm values and polish README and SLO routing guide
BenjaminBraunDev
committed
Clean up errors from rebase, add running request metric to datasource, add predictor to new 2 phase configuration parser
BenjaminBraunDev
committed
Add running request metric to extractor test
BenjaminBraunDev
committed
Fix epp image and add placeholder docker repos for latency sidecars
BenjaminBraunDev
committed
Update guide, README, and values.yaml
BenjaminBraunDev
committed