Skip to content

Commit 4e05b16

Browse files
committed
merge base
2 parents c3595d3 + 0a6dd5e commit 4e05b16

File tree

14 files changed

+862
-179
lines changed

14 files changed

+862
-179
lines changed

.github/workflows/development.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
name: Development
22

33
on:
4-
pull_request_target:
4+
pull_request:
55
types: [opened, synchronize, reopened]
66

77
jobs:

.gitignore

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -180,6 +180,9 @@ cython_debug/
180180
*.json
181181
*.yaml
182182

183+
# But not scenarios
184+
!src/guidellm/benchmark/scenarios/*.json
185+
!src/guidellm/benchmark/scenarios/*.yaml
183186

184187
# UI Section - Next.js/React application under src/ui/
185188
# dependencies

docs/datasets.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,6 +39,13 @@ GuideLLM supports several types of datasets, each with its own advantages and us
3939

4040
Synthetic datasets allow you to generate data on the fly with customizable parameters. This is useful for controlled experiments, stress testing, and simulating specific scenarios. For example, you might want to evaluate how a model handles long prompts or generates outputs with specific characteristics.
4141

42+
For different use cases, here are the recommended dataset profiles to pass as arguments in GuideLLM:
43+
44+
- **Chat**: `--data "prompt_tokens=512,output_tokens=256"`
45+
- **RAG**: `--data "prompt_tokens=4096,output_tokens=512"`
46+
- **Summarization**: `--data "prompt_tokens=1024,output_tokens=256"`
47+
- **Code Generation**: `--data "prompt_tokens=512,output_tokens=512"`
48+
4249
#### Example Commands
4350

4451
```bash

0 commit comments

Comments
 (0)