You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
-`--data`: Specified twice to mix real audio (openslr/librispeech_asr) and defaults for synthetic prompts.
290
-
-`--data-args`: Dataset arguments corresponding to the order of --data inputs (Librispeech config first, empty for synthetic).
291
-
-`--data-column-mapper`: Maps audio from the first dataset and text from the synthetic dataset (index 0) to the request.
289
+
-`--data`: Specified twice: first for synthetic prompt configuration (`prompt_tokens=256,output_tokens=128`), second for real audio from `openslr/librispeech_asr`.
290
+
-`--data-args`: Dataset arguments corresponding to the order of `--data` inputs (empty `{}` for synthetic prompts, LibriSpeech config second).
291
+
-`--data-column-mapper`: Maps audio from dataset index 1 (`"1.audio"`, LibriSpeech) and text from dataset index 0 (`"0.prompt"`, synthetic prompts) into each request.
292
292
293
293
The above command benchmarks the chat/completions endpoint on the target server using the prompt text from the synthetic dataset and audio from the LibriSpeech dataset. It will result in an output similar to the following:
0 commit comments