Skip to content

Commit 19df8b6

Browse files
Updates
1 parent fb0cb07 commit 19df8b6

File tree

1 file changed

+11
-7
lines changed

1 file changed

+11
-7
lines changed

content/learning-paths/laptops-and-desktops/win_on_arm_build_onnxruntime/4-run-benchmark-on-WoA.md

Lines changed: 11 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -8,31 +8,35 @@ layout: learningpathall
88

99
## Run the Phi-3 model on your Windows on Arm machine
1010

11-
In this section, you'll download the Phi-3 Mini model and run it on your Windows on Arm machine, which can be a physical or virtual machine. You'll be use a simple model runner program which provides performance metrics
11+
In this section, you'll download the Phi-3 Mini model and run it on your WoA machine - either physical or virtual. You'll use a simple model runner that also reports performance metrics.
1212

13-
The Phi-3 Mini (3.3B) model has a short (4k) context version and a long (128k) context version. The long context version can accept much longer prompts and produces longer output text, but it consumes more memory.
13+
The Phi-3 Mini (3.3B) model is available in two versions:
1414

15-
In this learning path, you'll use the short context version, which is quantized to 4-bits.
15+
- Short context (4K) - supports shorter prompts and uses less memory.
16+
- Long context (128K) - supports longer prompts and outputs but consumes more memory.
17+
18+
This Learning Path uses the short context version, which is quantized to 4-bits.
1619

1720
The Phi-3 Mini model used here is in ONNX format.
1821

1922
### Setup
2023

2124
[Phi-3 ONNX models](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-onnx) are hosted on HuggingFace.
22-
Hugging Face uses Git for both version control and to download the ONNX model files, which can be quite large.
25+
Hugging Face uses Git for both version control and to download the ONNX model files, which are large.
26+
27+
### Install Git LFS
2328

2429
You'll first need to install the Git Large File Storage (LFS) extension:
2530

2631
``` bash
2732
winget install -e --id GitHub.GitLFS
2833
git lfs install
2934
```
30-
If you don’t have winget, download and run the exe from the [official source](https://docs.github.com/en/repositories/working-with-files/managing-large-files/installing-git-large-file-storage?platform=windows).
35+
If you don’t have winget, [download the installer manually](https://docs.github.com/en/repositories/working-with-files/managing-large-files/installing-git-large-file-storage?platform=windows).
3136

3237
If the extension is already installed for you when you run the above ``git`` command it will say ``Git LFS initialized``.
3338

34-
You then need to install the ``HuggingFace CLI``.
35-
39+
You then need to install the ``HuggingFace CLI``
3640
``` bash
3741
pip install huggingface-hub[cli]
3842
```

0 commit comments

Comments
 (0)