We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent b876a03 commit 73ef6bdCopy full SHA for 73ef6bd
content/learning-paths/servers-and-cloud-computing/llama-cpu/_index.md
@@ -8,7 +8,7 @@ who_is_this_for: This is an introductory topic for developers interested in runn
8
learning_objectives:
9
- Download and build llama.cpp on your Arm server.
10
- Download a pre-quantized Llama 3.1 model from Hugging Face.
11
- - Re-quantize the model weights to take advantage of Arm improvements.
+ - Re-quantize the model weights to take advantage of the Arm KleidiAI kernels.
12
- Compare the pre-quantized Llama 3.1 model weights performance to the re-quantized weights on your Arm CPU.
13
14
prerequisites:
0 commit comments