Skip to content

Commit 52edd56

Browse files
committed
Set default failure injection rate to 0
Signed-off-by: Sergey Marunich <[email protected]>
1 parent 251813e commit 52edd56

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -124,7 +124,7 @@ For more details see the <a href="https://docs.vllm.ai/en/stable/getting_started
124124
- `tokenizers-cache-dir`: the directory for caching tokenizers
125125
- `hash-seed`: seed for hash generation (if not set, is read from PYTHONHASHSEED environment variable)
126126
- `zmq-endpoint`: ZMQ address to publish events
127-
- `failure-injection-rate`: probability (0-100) of injecting failures, optional, default is 10
127+
- `failure-injection-rate`: probability (0-100) of injecting failures, optional, default is 0
128128
- `failure-types`: list of specific failure types to inject (rate_limit, invalid_api_key, context_length, server_error, invalid_request, model_not_found), optional, if empty all types are used
129129
- `event-batch-size`: the maximum number of kv-cache events to be sent together, defaults to 16
130130
-->

pkg/common/config.go

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -199,7 +199,7 @@ func newConfig() *Configuration {
199199
TokenBlockSize: 16,
200200
ZMQEndpoint: "tcp://localhost:5557",
201201
EventBatchSize: 16,
202-
FailureInjectionRate: 10,
202+
FailureInjectionRate: 0,
203203
FailureTypes: []string{},
204204
}
205205
}

0 commit comments

Comments
 (0)