Skip to content

Commit c2c9c6a

Browse files
enhance name of router for comparation scenario (#79)
1 parent 1d81d33 commit c2c9c6a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

llmserve/backend/server/run.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ def llm_server(args: Union[str, LLMApp, List[Union[LLMApp, str]]]):
8080
).bind()
8181

8282
return RouterDeployment.options(
83-
name=_reverse_prefix(model.model_config.model_id) + "-route",
83+
name=('+'.join([_reverse_prefix(model.model_config.model_id) for model in models])) + "-router",
8484
max_concurrent_queries=max_concurrent_queries,
8585
**deployment_config,
8686
).bind(deployments, model_configs) # pylint:disable=no-member

0 commit comments

Comments
 (0)