-
Notifications
You must be signed in to change notification settings - Fork 500
Open
Description
Summary
do we need to add informer and support create httpRoute for LWS ? since we already support deployment rayclusterfleet and modelAdapter
func Add(mgr manager.Manager, runtimeConfig config.RuntimeConfig) error {
// ......
modelRouter := &ModelRouter{
Client: mgr.GetClient(),
RuntimeConfig: runtimeConfig,
}
_, err = deploymentInformer.AddEventHandler(cache.ResourceEventHandlerFuncs{
AddFunc: modelRouter.addRouteFromDeployment,
DeleteFunc: modelRouter.deleteRouteFromDeployment,
})
if err != nil {
return err
}
_, err = modelInformer.AddEventHandler(cache.ResourceEventHandlerFuncs{
AddFunc: modelRouter.addRouteFromModelAdapter,
DeleteFunc: modelRouter.deleteRouteFromModelAdapter,
})
if err != nil {
return err
}
_, err = fleetInformer.AddEventHandler(cache.ResourceEventHandlerFuncs{
AddFunc: modelRouter.addRouteFromRayClusterFleet,
DeleteFunc: modelRouter.deleteRouteFromRayClusterFleet,
})
return err
}Motivation
i want to use aibrix routing both deployment stormService and LWS, in some senario, we just use -H model: xxx routing request direct to service by httpRoute
Proposed Change
if we want to support LWS in model router controller by adding informer, I'd like to contribute
Alternatives Considered
No response
Metadata
Metadata
Assignees
Labels
No labels