Skip to content

Commit c70471d

Browse files
Merge pull request #1761 from jasonrandrews/review
Review deploy an AI agent on Arm with llama-cpp-agent Learning Path
2 parents 410f405 + 84d6d6f commit c70471d

File tree

4 files changed

+13
-7
lines changed

4 files changed

+13
-7
lines changed

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/_index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ learning_objectives:
1313

1414
prerequisites:
1515
- An [Arm-based instance](/learning-paths/servers-and-cloud-computing/csp/) from a cloud service provider or an on-premise Arm server.
16-
- Basic understanding of Python and Prompt Engineering.
16+
- Basic understanding of Python and prompt engineering.
1717
- Understanding of LLM fundamentals.
1818

1919
author: Andrew Choi

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/agent-output.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -153,7 +153,11 @@ Please write your prompt here:
153153

154154
When you are presented with `Please write your prompt here:` test it with an input prompt.
155155

156-
Enter `What is the current time?`
156+
Enter:
157+
158+
```console
159+
What is the current time?
160+
```
157161

158162
As part of the prompt, a list of executable functions is sent to the LLM, allowing the agent to select the appropriate function:
159163

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/ai-agent-backend.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,12 @@ weight: 4
66
layout: learningpathall
77
---
88

9-
## Python Script for executing an AI Agent application
10-
With `llama.cpp` built and the Llama3.1 8B model downloaded, you are now ready to create a Python script to execute an AI agent application:
9+
## Python script for executing an AI Agent application
10+
11+
With `llama.cpp` built and the Llama3.1 8B model downloaded, you are now ready to create a Python script to execute an AI agent application.
12+
13+
Use a text editor to create a Python file named `agent.py` with the content shown below:
1114

12-
Create a Python file named `agent.py` with the content shown below:
1315
```bash
1416
from enum import Enum
1517
from typing import Union

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/set-up.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ layout: learningpathall
88

99
## Before you begin
1010

11-
This Learning Path demonstrates how to build an AI Agent Application using open-source LLMs optimized for Arm architecture. The AI Agent can use Large Language Models (LLMs) to perform actions by accessing tools and knowledge.
11+
This Learning Path demonstrates how to build an AI Agent Application using open-source LLMs optimized for the Arm architecture. The AI Agent can use Large Language Models (LLMs) to perform actions by accessing tools and knowledge.
1212

13-
The instructions in this Learning Path have been designed for Arm servers running Ubuntu 22.04 LTS. You require an Arm server instance with at least 4 cores and 16GB of memory to run this example. Configure disk storage up to at least 32 GB. The instructions have been tested on an AWS EC2 Graviton3 `m7g.xlarge` instance.
13+
The instructions in this Learning Path have been designed for Arm servers running Ubuntu 22.04 LTS. You will need an Arm server instance with at least 4 cores and 16GB of memory. Configure disk storage for 32 GB or more. The instructions have been tested on an AWS EC2 Graviton3 `m7g.xlarge` instance.
1414

1515
## Overview
1616

0 commit comments

Comments
 (0)