Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion cmd/cli/commands/bench.go
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ func newBenchCmd() *cobra.Command {
)

cmd := &cobra.Command{
Use: "bench [MODEL]",
Use: "bench MODEL",
Short: "Benchmark a model's performance at different concurrency levels",
Long: `Benchmark a model's performance showing tokens per second at different concurrency levels.

Expand Down
2 changes: 1 addition & 1 deletion cmd/cli/docs/reference/docker_model_bench.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ long: |-

This command runs a series of benchmarks with 1, 2, 4, and 8 concurrent requests by default,
measuring the tokens per second (TPS) that the model can generate.
usage: docker model bench [MODEL]
usage: docker model bench MODEL
pname: docker model
plink: docker_model.yaml
options:
Expand Down
Loading