File tree Expand file tree Collapse file tree 1 file changed +3
-1
lines changed
deploy/openshift/openwebui Expand file tree Collapse file tree 1 file changed +3
-1
lines changed Original file line number Diff line number Diff line change @@ -40,6 +40,7 @@ oc get route openwebui -n vllm-semantic-router-system -o jsonpath='{.spec.host}'
4040## Configuration
4141
4242OpenWebUI is configured to connect to the Envoy proxy automatically:
43+
4344- ** Backend URL** : ` http://semantic-router.vllm-semantic-router-system.svc.cluster.local:8801/v1 `
4445- ** Available Models** : ` auto ` (load balancer), ` Model-A ` , ` Model-B `
4546- ** Port** : Service exposed on port 3000, mapped to container port 8080
@@ -48,6 +49,7 @@ OpenWebUI is configured to connect to the Envoy proxy automatically:
4849### OpenWebUI Settings
4950
5051When configuring OpenWebUI in the interface:
52+
5153- ** API Base URL** : ` http://semantic-router.vllm-semantic-router-system.svc.cluster.local:8801/v1 `
5254- ** API Key** : ` not-needed-for-local-models ` (or leave empty)
5355- ** Models** : Will auto-discover ` auto ` , ` Model-A ` , and ` Model-B `
@@ -92,4 +94,4 @@ oc delete -f route.yaml -f service.yaml -f deployment.yaml -f pvc.yaml
9294
9395- ** 503 Errors** : Check if service endpoints are available with ` oc get endpoints openwebui `
9496- ** Connection Issues** : Verify semantic-router is running with ` oc get pods -l app=semantic-router `
95- - ** Model Discovery** : Test backend connectivity with the deployment script validation
97+ - ** Model Discovery** : Test backend connectivity with the deployment script validation
You can’t perform that action at this time.
0 commit comments