SLO Aware Routing Sidecar + Plugin EPP Integration and Helm Deployment#1839

Merged

k8s-ci-robot merged 19 commits intokubernetes-sigs:mainfrom

BenjaminBraunDev:slo-aware-routing-stage-3

Nov 26, 2025

Commits on Nov 25, 2025

Add latency predictor plugins, deployment, and runner.go integration
BenjaminBraunDev
committed
Update dockerfile, fix issues with SLO context not being set when prediciton id off
BenjaminBraunDev
committed
Remove outdated inferencepool-resources deployment
BenjaminBraunDev
committed
Fix streamed request being called one final time after request complete, add predictor check to the beginning of each requestcontrol hook
BenjaminBraunDev
committed
add guide, update helm charts and readme, minor scorer changes
BenjaminBraunDev
committed
Make small guide update
BenjaminBraunDev
committed
Add helm values and polish README and SLO routing guide
BenjaminBraunDev
committed
Clean up errors from rebase, add running request metric to datasource, add predictor to new 2 phase configuration parser
BenjaminBraunDev
committed
Fix epp image and add placeholder docker repos for latency sidecars
BenjaminBraunDev
committed
Update guide, README, and values.yaml
BenjaminBraunDev
committed
Moved predictor setup logic into plugin
BenjaminBraunDev
committed
Move predictor startup login completely out of manager and into plugin, running routines there, move predictor helm section into new tpl file, rename slo-aware-routing guide and names in docs
BenjaminBraunDev
committed
Remove max-score-picker from list of plugin types in helm chart
BenjaminBraunDev
committed
Fix formatting
BenjaminBraunDev
committed
Revert go.mod to main
BenjaminBraunDev
committed
Fix typo in config, remove depreicated runtime flag
BenjaminBraunDev
committed
Rename latency prediction plugins, change docs accordingly, make sidecars not fail immediatly during EPP spinup
BenjaminBraunDev
committed
Update docs with new total running requests metric
BenjaminBraunDev
committed

Commits on Nov 26, 2025

Small plugin bugfix
BenjaminBraunDev
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

SLO Aware Routing Sidecar + Plugin EPP Integration and Helm Deployment#1839

SLO Aware Routing Sidecar + Plugin EPP Integration and Helm Deployment#1839
k8s-ci-robot merged 19 commits intokubernetes-sigs:mainfrom
BenjaminBraunDev:slo-aware-routing-stage-3

Commits on Nov 25, 2025

Add latency predictor plugins, deployment, and runner.go integration

Update dockerfile, fix issues with SLO context not being set when prediciton id off

Remove outdated inferencepool-resources deployment

Fix streamed request being called one final time after request complete, add predictor check to the beginning of each requestcontrol hook

add guide, update helm charts and readme, minor scorer changes

Make small guide update

Add helm values and polish README and SLO routing guide

Clean up errors from rebase, add running request metric to datasource, add predictor to new 2 phase configuration parser

Fix epp image and add placeholder docker repos for latency sidecars

Update guide, README, and values.yaml

Moved predictor setup logic into plugin

Move predictor startup login completely out of manager and into plugin, running routines there, move predictor helm section into new tpl file, rename slo-aware-routing guide and names in docs

Remove max-score-picker from list of plugin types in helm chart

Fix formatting

Revert go.mod to main

Fix typo in config, remove depreicated runtime flag

Rename latency prediction plugins, change docs accordingly, make sidecars not fail immediatly during EPP spinup

Update docs with new total running requests metric

Commits on Nov 26, 2025

Small plugin bugfix