Skip to content

Commit 99ca6a3

Browse files
authored
QNN: Pin AOT ort-qnn version to 1.22.2 (#114)
* pin oat version to 1.22.2 llama * pin transformers to 4.53.2
1 parent 6c16af3 commit 99ca6a3

File tree

12 files changed

+12
-12
lines changed

12 files changed

+12
-12
lines changed

Qwen-Qwen2.5-1.5B-Instruct/QNN/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232

3333
# Install ONNX Runtime QNN
3434
pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35-
pip install -U --pre --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+
pip install --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple "onnxruntime-qnn==1.22.2" --no-deps
3636
```
3737

3838
Replace `/path/to/qnn/env/bin` in [config.json](config.json) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:

Qwen-Qwen2.5-1.5B-Instruct/QNN/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55
onnxruntime-gpu==1.21.1
66
optimum
77
# newer transformers might have incompatibility with gptq passes
8-
transformers==4.52.4
8+
transformers==4.53.2

Qwen-Qwen2.5-7B-Instruct/QNN/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232

3333
# Install ONNX Runtime QNN
3434
pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35-
pip install -U --pre --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+
pip install --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple "onnxruntime-qnn==1.22.2" --no-deps
3636
```
3737

3838
Replace `/path/to/qnn/env/bin` in [config.json](config.json) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:

Qwen-Qwen2.5-7B-Instruct/QNN/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55
onnxruntime-gpu==1.21.1
66
optimum
77
# newer transformers might have incompatibility with gptq passes
8-
transformers==4.52.4
8+
transformers==4.53.2

meta-llama-Llama-3.1-8B-Instruct/QNN/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232

3333
# Install ONNX Runtime QNN
3434
pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35-
pip install -U --pre --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+
pip install --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple "onnxruntime-qnn==1.22.2" --no-deps
3636
```
3737

3838
Replace `/path/to/qnn/env/bin` in [config.json](config.json) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:

meta-llama-Llama-3.1-8B-Instruct/QNN/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55
onnxruntime-gpu==1.21.1
66
optimum
77
# newer transformers might have incompatibility with gptq passes
8-
transformers==4.52.4
8+
transformers==4.53.2

microsoft-Phi-3-mini-128k-instruct/QNN/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232

3333
# Install ONNX Runtime QNN
3434
pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35-
pip install -U --pre --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+
pip install --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple "onnxruntime-qnn==1.22.2" --no-deps
3636
```
3737

3838
Replace `/path/to/qnn/env/bin` in [config.json](config.json) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:

microsoft-Phi-3-mini-128k-instruct/QNN/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55
onnxruntime-gpu==1.21.1
66
optimum
77
# newer transformers might have incompatibility with gptq passes
8-
transformers==4.52.4
8+
transformers==4.53.2

microsoft-Phi-3-mini-4k-instruct/QNN/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232

3333
# Install ONNX Runtime QNN
3434
pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35-
pip install -U --pre --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+
pip install --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple "onnxruntime-qnn==1.22.2" --no-deps
3636
```
3737

3838
Replace `/path/to/qnn/env/bin` in [config.json](config.json) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:

microsoft-Phi-3-mini-4k-instruct/QNN/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55
onnxruntime-gpu==1.21.1
66
optimum
77
# newer transformers might have incompatibility with gptq passes
8-
transformers==4.52.4
8+
transformers==4.53.2

0 commit comments

Comments
 (0)