We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent c5f9751 commit 6ac6108Copy full SHA for 6ac6108
README.md
@@ -227,7 +227,7 @@ VLLM stats are reported by the metrics endpoint in fields that are prefixed with
227
counter_prompt_tokens
228
# Number of generation tokens processed.
229
counter_generation_tokens
230
-# Number of preemption tokens processed.
+# Cumulative number of preemption from the engine.
231
counter_preemption_tokens
232
# Histogram of number of tokens per engine_step.
233
histogram_iteration_tokens
0 commit comments