We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
2 parents f1fcfd8 + 73ef6bd commit 2adb292Copy full SHA for 2adb292
content/learning-paths/servers-and-cloud-computing/llama-cpu/_index.md
@@ -8,7 +8,7 @@ who_is_this_for: This is an introductory topic for developers interested in runn
8
learning_objectives:
9
- Download and build llama.cpp on your Arm server.
10
- Download a pre-quantized Llama 3.1 model from Hugging Face.
11
- - Re-quantize the model weights to take advantage of Arm improvements.
+ - Re-quantize the model weights to take advantage of the Arm KleidiAI kernels.
12
- Compare the pre-quantized Llama 3.1 model weights performance to the re-quantized weights on your Arm CPU.
13
14
prerequisites:
0 commit comments