File tree Expand file tree Collapse file tree 12 files changed +12
-12
lines changed
Qwen-Qwen2.5-1.5B-Instruct/QNN
Qwen-Qwen2.5-7B-Instruct/QNN
meta-llama-Llama-3.1-8B-Instruct/QNN
microsoft-Phi-3-mini-128k-instruct/QNN
microsoft-Phi-3-mini-4k-instruct/QNN
microsoft-Phi-3.5-mini-instruct/QNN Expand file tree Collapse file tree 12 files changed +12
-12
lines changed Original file line number Diff line number Diff line change @@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232
3333# Install ONNX Runtime QNN
3434pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35- pip install -U --pre --extra- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+ pip install -- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple " onnxruntime-qnn==1.22.2 " --no-deps
3636```
3737
3838Replace ` /path/to/qnn/env/bin ` in [ config.json] ( config.json ) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:
Original file line number Diff line number Diff line change @@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55onnxruntime-gpu == 1.21.1
66optimum
77# newer transformers might have incompatibility with gptq passes
8- transformers == 4.52.4
8+ transformers == 4.53.2
Original file line number Diff line number Diff line change @@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232
3333# Install ONNX Runtime QNN
3434pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35- pip install -U --pre --extra- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+ pip install -- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple " onnxruntime-qnn==1.22.2 " --no-deps
3636```
3737
3838Replace ` /path/to/qnn/env/bin ` in [ config.json] ( config.json ) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:
Original file line number Diff line number Diff line change @@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55onnxruntime-gpu == 1.21.1
66optimum
77# newer transformers might have incompatibility with gptq passes
8- transformers == 4.52.4
8+ transformers == 4.53.2
Original file line number Diff line number Diff line change @@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232
3333# Install ONNX Runtime QNN
3434pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35- pip install -U --pre --extra- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+ pip install -- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple " onnxruntime-qnn==1.22.2 " --no-deps
3636```
3737
3838Replace ` /path/to/qnn/env/bin ` in [ config.json] ( config.json ) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:
Original file line number Diff line number Diff line change @@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55onnxruntime-gpu == 1.21.1
66optimum
77# newer transformers might have incompatibility with gptq passes
8- transformers == 4.52.4
8+ transformers == 4.53.2
Original file line number Diff line number Diff line change @@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232
3333# Install ONNX Runtime QNN
3434pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35- pip install -U --pre --extra- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+ pip install -- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple " onnxruntime-qnn==1.22.2 " --no-deps
3636```
3737
3838Replace ` /path/to/qnn/env/bin ` in [ config.json] ( config.json ) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:
Original file line number Diff line number Diff line change @@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55onnxruntime-gpu == 1.21.1
66optimum
77# newer transformers might have incompatibility with gptq passes
8- transformers == 4.52.4
8+ transformers == 4.53.2
Original file line number Diff line number Diff line change @@ -32,7 +32,7 @@ pip install olive-ai==0.9.2
3232
3333# Install ONNX Runtime QNN
3434pip install -r https://raw.githubusercontent.com/microsoft/onnxruntime/refs/heads/main/requirements.txt
35- pip install -U --pre --extra- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple onnxruntime-qnn --no-deps
35+ pip install -- index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ORT-Nightly/pypi/simple " onnxruntime-qnn==1.22.2 " --no-deps
3636```
3737
3838Replace ` /path/to/qnn/env/bin ` in [ config.json] ( config.json ) with the path to the directory containing your QNN environment's Python executable. This path can be found by running the following command in the environment:
Original file line number Diff line number Diff line change @@ -5,4 +5,4 @@ onnxruntime-genai-cuda==0.7.1
55onnxruntime-gpu == 1.21.1
66optimum
77# newer transformers might have incompatibility with gptq passes
8- transformers == 4.52.4
8+ transformers == 4.53.2
You can’t perform that action at this time.
0 commit comments