frame_flutter_translate_host (offline speech-to-text, live captioning, offline translation, subtitles)

Connects to Frame, streams audio from the Host (phone) microphone (for now - streaming from Frame mic coming), which is sent through a local (on Host device) Vosk speech-to-text engine (Flutter package is Android only), translates the text into a target language on-device using ML Kit (Android, iOS only), and displays the translated text on the Frame display.

Drop in an alternative Vosk model to perform speech-to-text in a language other than Chinese (vosk-model-small-cn-0.22 included). The model name appears in main.dart and pubspec.yaml.

Specify an alternative targetLanguage in lib/main.dart to translate to an ML Kit supported language other than English. Frame only displays languages in a latin character set, so text might need to be tweaked before sending to Frame.

Frameshots, Screenshots

framecast1.mp4

Architecture

See Also

• Frame Flutter Speech-To-Text Host
• Frame Flutter Hello Hello