Skip to content

Enable SVC in RAW mode when installing KServe Serverless #534

@smhgit

Description

@smhgit
  • Install KServe serverless
  • Create ISVC in Raw mode

=> SVC is not workiing. Only direct access to the POD with port.

The reason is that the SVC is headless. Here is an example:

kind: Service
apiVersion: v1
metadata:
  annotations:
    serving.kserve.io/deploymentMode: RawDeployment
  name: m6608c280011011-predictor
  labels:
    app: isvc.m6608c280011011-predictor
    component: predictor
    networking.kserve.dev/visibility: cluster-local
    serving.kserve.io/inferenceservice: m6608c280011011
spec:
  clusterIP: None
  ipFamilies:
    - IPv4
  ports:
    - name: m6608c280011011-predictor
      protocol: TCP
      port: 80
      targetPort: 8080
  internalTrafficPolicy: Cluster
  clusterIPs:
    - None
  type: ClusterIP
  ipFamilyPolicy: SingleStack
  sessionAffinity: None
  selector:
    app: isvc.m6608c280011011-predictor
status:
  loadBalancer: {}

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind/bugSomething isn't working

    Type

    No type

    Projects

    Status

    New/Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions