Commit 6379f42
Add backend_kwargs to generate_benchmark_report (#78)
This PR adds support for passing additional keyword arguments to the
backend used in the `generate_benchmark_report` function. This allows us
to use the already-implemented [`request_args`
parameter](https://github.com/neuralmagic/guidellm/blob/ecf2984645202eea022cc7c9f245947e2dd5457d/src/guidellm/backend/openai.py#L37)
on `OpenAIBackend`, which is needed in order to pass [custom
headers/query
params/etc](https://github.com/openai/openai-python/blob/3e69750d47df4f0759d4a28ddc68e4b38756d9ca/src/openai/resources/beta/chat/completions.py#L100)
to OpenAI chat completion requests.
---------
Co-authored-by: Mark Kurtz <[email protected]>1 parent 7f611a5 commit 6379f42
1 file changed
+4
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | | - | |
| 2 | + | |
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
| |||
197 | 197 | | |
198 | 198 | | |
199 | 199 | | |
| 200 | + | |
200 | 201 | | |
201 | 202 | | |
202 | 203 | | |
| |||
218 | 219 | | |
219 | 220 | | |
220 | 221 | | |
| 222 | + | |
221 | 223 | | |
222 | 224 | | |
223 | 225 | | |
| |||
228 | 230 | | |
229 | 231 | | |
230 | 232 | | |
| 233 | + | |
231 | 234 | | |
232 | 235 | | |
233 | 236 | | |
| |||
0 commit comments