Skip to content

Commit 0080634

Browse files
committed
merge main
2 parents 35c1489 + 0e78c65 commit 0080634

File tree

16 files changed

+1282
-973
lines changed

16 files changed

+1282
-973
lines changed

.gitignore

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -179,6 +179,9 @@ cython_debug/
179179
*.json
180180
*.yaml
181181

182+
# But not scenarios
183+
!src/guidellm/benchmark/scenarios/*.json
184+
!src/guidellm/benchmark/scenarios/*.yaml
182185

183186
# UI Section - Next.js/React application under src/ui/
184187
# dependencies

docs/datasets.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,13 @@ GuideLLM supports several types of datasets, each with its own advantages and us
3939

4040
Synthetic datasets allow you to generate data on the fly with customizable parameters. This is useful for controlled experiments, stress testing, and simulating specific scenarios. For example, you might want to evaluate how a model handles long prompts or generates outputs with specific characteristics.
4141

42+
For different use cases, here are the recommended dataset profiles to pass as arguments in GuideLLM:
43+
44+
- **Chat**: `--data "prompt_tokens=512,output_tokens=256"`
45+
- **RAG**: `--data "prompt_tokens=4096,output_tokens=512"`
46+
- **Summarization**: `--data "prompt_tokens=1024,output_tokens=256"`
47+
- **Code Generation**: `--data "prompt_tokens=512,output_tokens=512"`
48+
4249
#### Example Commands
4350

4451
```bash

0 commit comments

Comments
 (0)