You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+6Lines changed: 6 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,3 +8,9 @@ The `accuracy` folder contains YAML files for each model that configures informa
8
8
* client.yml: contains settings for the llm-eval-test harness for the model
9
9
* accuracy.yml: contains evaluation tasks and accuracy expectations for the model
10
10
* storage.yml: specifies where mode and dataset is located
11
+
12
+
The `benchmark` folder contains YAML files for each model that configures information needed for the model to be validated through the [guidellm](https://github.com/neuralmagic/guidellm). There are config files for each model:
13
+
14
+
* server.yml: contains settings to start a vllm server with the model
15
+
* client.yml: contains settings for the guidellm for the model
16
+
* storage.yml: specifies where mode and dataset is located
0 commit comments