Skip to content

Commit e0319b1

Browse files
Updates
1 parent 2bac82c commit e0319b1

File tree

3 files changed

+17
-13
lines changed

3 files changed

+17
-13
lines changed

content/learning-paths/laptops-and-desktops/win_on_arm_build_onnxruntime/1-dev-env-setup.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ Specifically, you'll learn how to:
2020
The short-context version accepts shorter (4K) prompts and generates shorter outputs than the long-context (128K) version. It also consumes less memory.
2121
{{% /notice %}}
2222

23-
## Set up your Development Environment
23+
## Set up your development environment
2424

2525
Your first task is to prepare a development environment with the required software.
2626

content/learning-paths/laptops-and-desktops/win_on_arm_build_onnxruntime/3-build-onnxruntime-generate-api.md

Lines changed: 15 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -6,21 +6,23 @@ weight: 4
66
layout: learningpathall
77
---
88

9-
## Compile the ONNX Runtime Generate() API for Windows on Arm
9+
## Build the ONNX Runtime Generate() API for Windows on Arm
1010

1111
The Generate() API in ONNX Runtime is designed for text generation tasks using models like Phi-3. It implements the generative AI loop for ONNX models, including:
1212
- Pre- and post-processing.
13-
- Inference with ONNX Runtime- logits processing.
13+
- Inference with ONNX Runtime (including logits processing).
1414
- Search and sampling.
1515
- KV cache management.
1616

17-
You can learn more by reading the [ONNX Runtime Generate() API page](https://onnxruntime.ai/docs/genai/).
17+
{{% notice Learning Tip %}}
18+
You can learn more about this area by reading the [ONNX Runtime Generate() API documentation](https://onnxruntime.ai/docs/genai/).
19+
{{% /notice %}}
1820

19-
In this section you will learn how to build the Generate API() from source.
21+
In this section, you'll build the Generate API() from source.
2022

2123

22-
### Clone onnxruntime-genai Repo
23-
Within your Windows Developer Command Prompt for Visual Studio, checkout the source repo:
24+
### Clone the onnxruntime-genai repository
25+
From your **Windows Developer Command Prompt for Visual Studio**, clone the repository and checkout the following tested commit:
2426

2527
```bash
2628
cd C:\Users\%USERNAME%
@@ -35,18 +37,20 @@ You might be able to use later commits. These steps have been tested with the co
3537
{{% /notice %}}
3638

3739
### Build for Windows on Arm
38-
The build command below has a ---config argument, which takes the following options:
39-
- ```Release``` builds release build
40-
- ```Debug``` builds binaries with debug symbols
41-
- ```RelWithDebInfo``` builds release binaries with debug info
40+
The build script uses a ---config argument, which supports the following options:
41+
- ```Release``` builds release build.
42+
- ```Debug``` builds binaries with debug symbols.
43+
- ```RelWithDebInfo``` builds release binaries with debug info.
4244

43-
You will build the `Release` variant of the ONNX Runtime Generate() API:
45+
To build the `Release` variant of the ONNX Runtime Generate() API:
4446

4547
```bash
4648
pip install requests
4749
python build.py --config Release --skip_tests
4850
```
4951

52+
### Verify the output
53+
5054
When the build is complete, confirm the ONNX Runtime Generate() API Dynamic Link Library has been created:
5155

5256
```output

content/learning-paths/laptops-and-desktops/win_on_arm_build_onnxruntime/4-run-benchmark-on-WoA.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ After a successful build, the binary `phi3` will be created in the ''onnxruntime
8181
dir Release\phi3.exe
8282
```
8383

84-
#### Run the model
84+
### Run the model
8585

8686
Execute the model using the following command:
8787

0 commit comments

Comments
 (0)