Skip to content

[RFC]: Support LWS in modelRouter controller #1839

@rayne-Li

Description

@rayne-Li

Summary

do we need to add informer and support create httpRoute for LWS ? since we already support deployment rayclusterfleet and modelAdapter

func Add(mgr manager.Manager, runtimeConfig config.RuntimeConfig) error {
	// ......
	modelRouter := &ModelRouter{
		Client:        mgr.GetClient(),
		RuntimeConfig: runtimeConfig,
	}

	_, err = deploymentInformer.AddEventHandler(cache.ResourceEventHandlerFuncs{
		AddFunc:    modelRouter.addRouteFromDeployment,
		DeleteFunc: modelRouter.deleteRouteFromDeployment,
	})
	if err != nil {
		return err
	}

	_, err = modelInformer.AddEventHandler(cache.ResourceEventHandlerFuncs{
		AddFunc:    modelRouter.addRouteFromModelAdapter,
		DeleteFunc: modelRouter.deleteRouteFromModelAdapter,
	})
	if err != nil {
		return err
	}

	_, err = fleetInformer.AddEventHandler(cache.ResourceEventHandlerFuncs{
		AddFunc:    modelRouter.addRouteFromRayClusterFleet,
		DeleteFunc: modelRouter.deleteRouteFromRayClusterFleet,
	})

	return err
}

Motivation

i want to use aibrix routing both deployment stormService and LWS, in some senario, we just use -H model: xxx routing request direct to service by httpRoute

Proposed Change

if we want to support LWS in model router controller by adding informer, I'd like to contribute

Alternatives Considered

No response

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions