File tree Expand file tree Collapse file tree 2 files changed +2
-7
lines changed
content/learning-paths/servers-and-cloud-computing/onnx Expand file tree Collapse file tree 2 files changed +2
-7
lines changed Original file line number Diff line number Diff line change @@ -143,7 +143,7 @@ if __name__ == "__main__":
143143 run(args)
144144```
145145
146- ## Run the Server
146+ ## Run the server
147147
148148You’re now ready to run the chatbot server.
149149
Original file line number Diff line number Diff line change @@ -46,12 +46,7 @@ Use a file editor of your choice and create a `requirements.txt` file with the P
4646 transformers
4747 accelerate
4848 huggingface- hub
49- pyreadline3
5049```
51- {{% notice Note %}}
52- ` pyreadline3 ` is typically used on Windows systems. You can safely omit it on Linux.
53- {{% /notice %}}
54-
5550
5651## Install Python dependencies
5752
@@ -86,7 +81,7 @@ Ensure you're using Python 3.12 to match the cp312 wheel format.
8681
8782This build includes optimizations from Kleidi AI for efficient inference on Arm CPUs.
8883
89- ## Download and quantize the Model
84+ ## Download and quantize the model
9085
9186Navigate to your home directory. Now download the quantized model using ` huggingface-cli ` :
9287``` bash
You can’t perform that action at this time.
0 commit comments