Skip to content

Commit 2aa7ffa

Browse files
author
Dmytro Parfeniuk
committed
Concurrent rate type (load generation mode) is explained
1 parent 0917f66 commit 2aa7ffa

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -120,9 +120,10 @@ GuideLLM provides various CLI and environment options to customize evaluations,
120120

121121
Some typical configurations for the CLI include:
122122

123-
- `--rate-type`: The rate to use for benchmarking. Options include `sweep`, `synchronous`, `throughput`, `constant`, and `poisson`.
123+
- `--rate-type`: The rate to use for benchmarking. Options include `sweep`, `synchronous`, `concurrent`, `throughput`, `constant`, and `poisson`.
124124
- `--rate-type sweep`: (default) Sweep runs through the full range of the server's performance, starting with a `synchronous` rate, then `throughput`, and finally, 10 `constant` rates between the min and max request rate found.
125125
- `--rate-type synchronous`: Synchronous runs requests synchronously, one after the other.
126+
- `--rate-type concurrent`: Concurrent runs requests concurrently in multiple threads. One request per thread. Number of threads is specified with `--rate` argument.
126127
- `--rate-type throughput`: Throughput runs requests in a throughput manner, sending requests as fast as possible.
127128
- `--rate-type constant`: Constant runs requests at a constant rate. Specify the request rate per second with the `--rate` argument. For example, `--rate 10` or multiple rates with `--rate 10 --rate 20 --rate 30`.
128129
- `--rate-type poisson`: Poisson draws from a Poisson distribution with the mean at the specified rate, adding some real-world variance to the runs. Specify the request rate per second with the `--rate` argument. For example, `--rate 10` or multiple rates with `--rate 10 --rate 20 --rate 30`.

0 commit comments

Comments
 (0)