Skip to content

Inference graph fails to work on ODH deployed on IBM Cloud OpenShift cluster #145

@eyalcha

Description

@eyalcha

Inference graph doesn't returns a response when sending inference request. Same configuration works on K8S cluster. Issue seems to be related to Istio.

{
    "apiVersion": "serving.kserve.io/v1alpha1",
    "kind": "InferenceGraph",
    "metadata": {
        "name": "demo1",
        "labels": {
            "component": "splitter"
        },
        "annotations": {
            "sidecar.istio.io/inject": "true",
            "sidecar.istio.io/rewriteAppHTTPProbers": "true",
            "serving.knative.openshift.io/enablePassthrough": "true"
        }
    },
    "spec": {
        "nodes": {
            "root": {
                "routerType": "Splitter",
                "steps": [
                    {
                        "serviceName": "m252a1840",
                        "weight": 100
                    }
                ]
            }
        }
    }
}
image

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugSomething isn't working

    Type

    No type

    Projects

    Status

    New/Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions