You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To run the model, we will use the Voxtral runner, which utilizes ExecuTorch's MultiModal runner API.
47
47
The Voxtral runner will do the following things:
48
48
1.[Optional] Pass the raw audio tensor into exported preprocessor to produce a mel spectrogram tensor.
49
-
2.[If starting directly with an already processed audio input tensor, starts here] Formats the inputs to the multimodal runner (metadata tokens, audio tokens, text tokens, etc.).
49
+
2.[If starting directly with an already processed audio input tensor] Format the inputs to the multimodal runner (metadata tokens, audio tokens, text tokens, etc.).
50
50
3. Feed the formatted inputs to the multimodal modal runner.
51
51
52
52
## Building the multimodal runner
@@ -68,6 +68,20 @@ You can download the `tekken.json` tokenizer from [Voxtral's HuggingFace repo](h
68
68
--audio_path ~/models/voxtral/audio_input.bin
69
69
```
70
70
71
+
Example output:
72
+
```
73
+
The speaker in this audio seems to be talking about their concerns about a device called the model or maybe they're just talking about the model in general. They mention that the model was trained with the speaker for inference, which suggests that
74
+
the model was trained based on the speaker's data or instructions. They also mention that the volume is quite small, which could imply that the speaker is trying to control the volume of the model's output, likely because they are concerned about how loud the model's responses might
0 commit comments