Skip to content

Commit fc20338

Browse files
committed
Cleanup flags with default values in values yaml
1 parent 137a0b4 commit fc20338

File tree

2 files changed

+1
-43
lines changed

2 files changed

+1
-43
lines changed

config/charts/inferencepool/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -124,7 +124,7 @@ The following table list the configurable parameters of the chart.
124124
| `inferenceExtension.extraServicePorts` | List of additional service ports to expose. Defaults to `[]`. |
125125
| `inferenceExtension.flags` | List of flags which are passed through to endpoint picker. |
126126
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: `gke`. Defaults to `none`. |
127-
| `inferenceExtension.enableLeaderElection` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. It is recommended to set `inferenceExtension.replicas` to a value greater than 1 when this is set to `true`. Defaults to `false`. |
127+
| `inferenceExtension.flags.has-enable-leader-election` | Enable leader election for high availability. When enabled, only one EPP pod (the leader) will be ready to serve traffic. It is recommended to set `inferenceExtension.replicas` to a value greater than 1 when this is set to `true`. Defaults to `false`. |
128128

129129

130130
## Notes

config/charts/inferencepool/values.yaml

Lines changed: 0 additions & 42 deletions
Original file line numberDiff line numberDiff line change
@@ -32,51 +32,9 @@ inferenceExtension:
3232
# ENABLE_EXPERIMENTAL_FEATURE: "true"
3333

3434
flags:
35-
- name: grpc-port
36-
value: 9002
37-
- name: grpc-health-port
38-
value: 9003
39-
- name: metrics-port
40-
value: 9090
41-
- name: enable-pprof
42-
value: "true" # Enable pprof handlers for profiling and debugging
43-
- name: pool-group
44-
value: "inference.networking.k8s.io"
4535
# Log verbosity
4636
- name: v
4737
value: 1
48-
- name: secure-serving
49-
value: "true"
50-
- name: health-checking
51-
value: "false"
52-
- name: cert-path
53-
value: ""
54-
- name: total-queued-requests-metric
55-
value: "vllm:num_requests_waiting"
56-
- name: kv-cache-usage-percentage-metric
57-
value: "vllm:gpu_cache_usage_perc"
58-
- name: lora-info-metric
59-
value: "vllm:lora_requests_info"
60-
- name: refresh-metrics-interval
61-
value: "50ms"
62-
- name: refresh-prometheus-metrics-interval
63-
value: "5s"
64-
- name: metrics-staleness-threshold
65-
value: "2s"
66-
- name: config-file
67-
value: ""
68-
- name: config-text
69-
value: ""
70-
- name: model-server-metrics-port
71-
value: 0
72-
- name: model-server-metrics-path
73-
value: "/metrics"
74-
- name: model-server-metrics-scheme
75-
value: "http"
76-
- name: model-server-metrics-https-insecure-skip-verify
77-
value: "true"
78-
- name: has-enable-leader-election
79-
value: false
8038

8139
inferencePool:
8240
targetPorts:

0 commit comments

Comments
 (0)