Skip to content

Commit 0b4e614

Browse files
authored
Merge pull request #2406 from annietllnd/ViT_update
Update vision LLM on Android LP
2 parents 050c9be + d33a304 commit 0b4e614

File tree

1 file changed

+7
-5
lines changed
  • content/learning-paths/mobile-graphics-and-gaming/vision-llm-inference-on-android-with-kleidiai-and-mnn

1 file changed

+7
-5
lines changed

content/learning-paths/mobile-graphics-and-gaming/vision-llm-inference-on-android-with-kleidiai-and-mnn/1-devenv-and-model.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,9 @@ sudo apt update
1818
sudo apt install cmake git-lfs -y
1919
```
2020

21-
You can use Android Studio to obtain the NDK.
21+
You can use Android Studio to obtain the NDK.
2222

23-
Click **Tools > SDK Manager** and navigate to the **SDK Tools** tab.
23+
Click **Tools > SDK Manager** and navigate to the **SDK Tools** tab.
2424

2525
Select the **NDK (Side by side)** and **CMake** checkboxes, as shown below:
2626

@@ -55,7 +55,7 @@ source vision_llm/bin/activate
5555

5656
## Set up Phone Connection
5757

58-
You need to set up an authorized connection with your phone. The Android SDK Platform Tools package, included with Android Studio, provides Android Debug Bridge (ADB) for transferring files.
58+
You need to set up an authorized connection with your phone. The Android SDK Platform Tools package, included with Android Studio, provides Android Debug Bridge (ADB) for transferring files.
5959

6060
Connect your phone to your computer using a USB cable, and enable USB debugging on your phone. To do this, tap the **Build Number** in your **Settings** app 7 times, then enable **USB debugging** in **Developer Options**.
6161

@@ -79,7 +79,9 @@ The pre-quantized model is available in Hugging Face, you can download with the
7979
```bash
8080
git lfs install
8181
git clone https://huggingface.co/taobao-mnn/Qwen2.5-VL-3B-Instruct-MNN
82+
cd Qwen2.5-VL-3B-Instruct-MNN
8283
git checkout a4622194b3c518139e2cb8099e147e3d71975f7a
84+
cd ..
8385
```
8486

8587
## (Optional) Download and Convert the Model
@@ -133,11 +135,11 @@ Verify that the model was built correctly by checking that the `Qwen2.5-VL-3B-In
133135

134136
## Push the model to Android device
135137

136-
Push the model onto the device:
138+
Push the repository you cloned earlier onto the device:
137139

138140
```shell
139141
adb shell mkdir /data/local/tmp/models/
140-
adb push Qwen2.5-VL-3B-Instruct-MNN /data/local/tmp/models
142+
adb push Qwen2.5-VL-3B-Instruct-MNN/ /data/local/tmp/models
141143
```
142144

143145
With the model set up, you're ready to build and run an example application.

0 commit comments

Comments
 (0)