Skip to content

Commit c3aae8d

Browse files
authored
present kv-cache related configuration parameters in readme file (#149)
Signed-off-by: Maya Barnea <[email protected]>
1 parent 54efd5b commit c3aae8d

File tree

1 file changed

+0
-2
lines changed

1 file changed

+0
-2
lines changed

README.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -116,15 +116,13 @@ For more details see the <a href="https://docs.vllm.ai/en/stable/getting_started
116116
- `min-tool-call-array-param-length`: the minimum possible length of array parameters in a tool call, optional, defaults to 1
117117
- `tool-call-not-required-param-probability`: the probability to add a parameter, that is not required, in a tool call, optional, defaults to 50
118118
- `object-tool-call-not-required-field-probability`: the probability to add a field, that is not required, in an object in a tool call, optional, defaults to 50
119-
<!--
120119
- `enable-kvcache`: if true, the KV cache support will be enabled in the simulator. In this case, the KV cache will be simulated, and ZQM events will be published when a KV cache block is added or evicted.
121120
- `kv-cache-size`: the maximum number of token blocks in kv cache
122121
- `block-size`: token block size for contiguous chunks of tokens, possible values: 8,16,32,64,128
123122
- `tokenizers-cache-dir`: the directory for caching tokenizers
124123
- `hash-seed`: seed for hash generation (if not set, is read from PYTHONHASHSEED environment variable)
125124
- `zmq-endpoint`: ZMQ address to publish events
126125
- `event-batch-size`: the maximum number of kv-cache events to be sent together, defaults to 16
127-
-->
128126
- `fake-metrics`: represents a predefined set of metrics to be sent to Prometheus as a substitute for the actual data. When specified, only these fake metrics will be reported — real metrics and fake metrics will never be reported simultaneously. The set should include values for
129127
- `running-requests`
130128
- `waiting-requests`

0 commit comments

Comments
 (0)