Skip to content

feature: operator vLLMRouter : missing routingLogic : prefixaware and kvaware #862

@dotmobo

Description

@dotmobo

Describe the feature

Hi

Is it possible to add prefixaware and kvaware for routingLogic in vllmrouter operator ?

Only roundrobin and session are currently available

Thanks

Why do you need this feature?

using prefixaware and kvaware in production in openshift with CRD

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions