You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To deploy the EndpointPicker in a high-availability (HA) active-passive configuration, you can enable leader election. When enabled, the EPP deployment will have multiple replicas, but only one "leader" replica will be active and ready to process traffic at any given time. If the leader pod fails, another pod will be elected as the new leader, ensuring service continuity.
85
85
86
-
To enable HA, set `inferenceExtension.enableLeaderElection` to `true` and increase the number of replicas in your `values.yaml` file:
86
+
To enable HA, set `inferenceExtension.flags.has-enable-leader-election` to `true` and increase the number of replicas in your `values.yaml` file:
@@ -122,10 +122,9 @@ The following table list the configurable parameters of the chart.
122
122
|`inferenceExtension.env`| List of environment variables to set in the endpoint picker container as free-form YAML. Defaults to `[]`. |
123
123
|`inferenceExtension.extraContainerPorts`| List of additional container ports to expose. Defaults to `[]`. |
124
124
|`inferenceExtension.extraServicePorts`| List of additional service ports to expose. Defaults to `[]`. |
125
-
|`inferenceExtension.flags`| List of flags which are passed through to endpoint picker. |
125
+
|`inferenceExtension.flags`| List of flags which are passed through to endpoint picker. Example flags, enable-pprof, grpc-port etc. Refer [runner.go](https://github.com/kubernetes-sigs/gateway-api-inference-extension/blob/main/cmd/epp/runner/runner.go) for complete list. |
126
+
|`inferenceExtension.flags.has-enable-leader-election`| Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. |
126
127
|`provider.name`| Name of the Inference Gateway implementation being used. Possible values: `gke`. Defaults to `none`. |
127
-
|`inferenceExtension.enableLeaderElection`| Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. It is recommended to set `inferenceExtension.replicas` to a value greater than 1 when this is set to `true`. Defaults to `false`. |
0 commit comments