You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: examples/demo-apps/apple_ios/LLaMA/docs/delegates/xnnpack_README.md
+14-26Lines changed: 14 additions & 26 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,40 +13,41 @@ More specifically, it covers:
13
13
## Setup ExecuTorch
14
14
In this section, we will need to set up the ExecuTorch repo first with Conda environment management. Make sure you have Conda available in your system (or follow the instructions to install it [here](https://conda.io/projects/conda/en/latest/user-guide/install/index.html)). The commands below are running on Linux (CentOS).
Optional: Use the --pybind flag to install with pybindings.
34
+
35
+
Install dependencies
36
+
38
37
```
39
-
./install_executorch.sh --pybind xnnpack
38
+
./install_executorch.sh
40
39
```
40
+
41
41
## Prepare Models
42
42
In this demo app, we support text-only inference with up-to-date Llama models and image reasoning inference with LLaVA 1.5.
43
43
* You can request and download model weights for Llama through Meta official [website](https://llama.meta.com/).
44
44
* For chat use-cases, download the instruct models instead of pretrained.
45
45
* Install the required packages to export the model:
46
46
47
47
```
48
-
sh examples/models/llama/install_requirements.sh
48
+
./examples/models/llama/install_requirements.sh
49
49
```
50
+
50
51
### For Llama 3.2 1B and 3B SpinQuant models
51
52
Meta has released prequantized INT4 SpinQuant Llama 3.2 models that ExecuTorch supports on the XNNPACK backend.
52
53
* Export Llama model and generate .pte file as below:
@@ -112,19 +113,6 @@ There are two options to add ExecuTorch runtime package into your XCode project:
112
113
113
114
The current XCode project is pre-configured to automatically download and link the latest prebuilt package via Swift Package Manager.
114
115
115
-
If you have an old ExecuTorch package cached before in XCode, or are running into any package dependencies issues (incorrect checksum hash, missing package, outdated package), close XCode and run the following command in terminal inside your ExecuTorch directory
The command above will clear all the package cache, and when you re-open the XCode project, it should re-download the latest package and link them correctly.
127
-
128
116
#### (Optional) Changing the prebuilt package version
129
117
While we recommended using the latest prebuilt package pre-configured with the XCode project, you can also change the package version manually to your desired version.
0 commit comments