You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
and build for various platforms to independently benchmark STT functionality:
42
+
You can build the pipeline for various platforms and independently benchmark the STT functionality:
43
43
44
44
|Platform|Details|
45
45
|---|---|
46
46
|Linux|x86_64 - KleidiAI is disabled by default, aarch64 - KleidiAI is enabled by default.|
47
47
|Android|Cross-compile for an Android device, ensure the Android NDK path is set and correct toolchain file is provided. KleidiAI enabled by default.|
48
-
|MacOS|Native or cross-compilation for a Mac device. KleidiAI and SME kernels can be used if available on device.|
48
+
|macOS|Native or cross-compilation for a Mac device. KleidiAI and SME kernels can be used if available on device.|
49
49
50
-
Currently, this module uses [whisper.cpp](https://github.com/ggml-org/whisper.cpp) and wraps the backend library by a thin C++ layer. The module also provides JNI bindings for developers targetting Android based applications.
50
+
Currently, this module uses [whisper.cpp](https://github.com/ggml-org/whisper.cpp) and wraps the backend library with a thin C++ layer. The module also provides JNI bindings for developers targeting Android based applications.
51
51
52
52
{{% notice %}}
53
53
You can get more information on how to build and use this module [here](https://gitlab.arm.com/kleidi/kleidi-examples/speech-to-text/-/blob/main/README.md?ref_type=heads)
@@ -67,15 +67,15 @@ The voice assistant pipeline imports and builds a separate module to provide thi
@@ -94,4 +94,4 @@ This part of the application pipeline uses the Android Text-to-Speech API along
94
94
95
95
In synchronous mode, speech playback begins only after the full LLM response is received. By default, the application operates in asynchronous mode, where speech synthesis starts as soon as a full or partial sentence is ready. Remaining tokens are buffered and processed by the Android Text-to-Speech engine to ensure uninterrupted playback.
96
96
97
-
You are now familiar with the building blocks of this application and can build these independently for various platforms. You can now build the multi-modal Voice Assistant example which runs on Android OS in the next step.
97
+
You are now familiar with the building blocks of this application and can build these independently for various platforms. You can now build the multimodal Voice Assistant example which runs on Android OS in the next step.
Copy file name to clipboardExpand all lines: content/learning-paths/mobile-graphics-and-gaming/voice-assistant/5-kleidiai.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -31,5 +31,5 @@ To disable KleidiAI during build:
31
31
32
32
KleidiAI simplifies development by abstracting away low-level optimization: developers can write high-level code while the KleidiAI library selects the most efficient implementation at runtime based on the target hardware. This is possible thanks to its deeply optimized micro-kernels tailored for Arm architectures.
33
33
34
-
As newer versions of the architecture become available, KleidiAI becomes even more powerful: simply updating the library allows applications like the multi-modal Voice Assistant to take advantage of the latest architectural improvements - such as SME2 — without requiring any code changes. This means better performance on newer devices with no additional effort from developers.
34
+
As newer versions of the architecture become available, KleidiAI becomes even more powerful: simply updating the library allows applications like the multimodal Voice Assistant to take advantage of the latest architectural improvements such as SME2, without requiring any code changes. This means better performance on newer devices with no additional effort from developers.
Copy file name to clipboardExpand all lines: content/learning-paths/mobile-graphics-and-gaming/voice-assistant/_index.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,15 +1,15 @@
1
1
---
2
-
title: Accelerate multi-modal Voice Assistant performance with KleidiAI and SME2
2
+
title: Accelerate multimodal Voice Assistant performance with KleidiAI and SME2
3
3
4
4
minutes_to_complete: 30
5
5
6
-
who_is_this_for: This is an introductory topic for developers who want to see a pipeline of a multi-modal Voice Assistant application and accelerate the performance on Android devices using KleidiAI and SME2.
6
+
who_is_this_for: This is an introductory topic for developers who want to implement a multimodal pipeline for a Voice Assistant application and accelerate the performance on Android devices using KleidiAI and SME2.
7
7
8
8
learning_objectives:
9
-
- Learn about the multi-modal Voice Assistant pipeline and different components used.
9
+
- Learn about the multimodal Voice Assistant pipeline and different components used.
10
10
- Learn about the functionality of ML components used and how these can be built and benchmarked on various platforms.
11
-
- Compile and run a multi-modal Voice Assistant example based on Android OS.
12
-
- Optimize performance of multi-modal Voice Assistant using KleidiAI and SME2.
11
+
- Compile and run a multimodal Voice Assistant example based on Android OS.
12
+
- Optimize performance of multimodal Voice Assistant using KleidiAI and SME2.
13
13
14
14
prerequisites:
15
15
- An Android phone that supports the i8mm Arm architecture feature (8-bit integer matrix multiplication). This Learning Path was tested on a Google Pixel 8 Pro.
0 commit comments