Skip to content

Commit a0d9944

Browse files
Further edits
1 parent a61e34a commit a0d9944

File tree

4 files changed

+14
-12
lines changed

4 files changed

+14
-12
lines changed

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/agent-output.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: Understand and test the AI Agent
2+
title: Understand and Test the AI Agent
33
weight: 5
44

55
### FIXED, DO NOT MODIFY
@@ -8,7 +8,7 @@ layout: learningpathall
88

99
## AI Agent Function Calls
1010

11-
An AI agent, powered by a Large Language Model (LLM), decides which function to use by analyzing the prompt or input it receives, identifying the relevant intent or task, and then matching the intent to the most appropriate function from a pre-defined set of available functions based on its understanding of the language and context.
11+
An AI agent, powered by a LLM, selects the most appropriate function by analyzing the prompt or input it receives, identifying the relevant intent or task, and then matching the intent to the most appropriate function from a pre-defined set of available functions based on its understanding of the language and context.
1212

1313
Have a look at how this is implemented in the python script `agent.py`:
1414

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/ai-agent-backend.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ layout: learningpathall
77
---
88

99
## Python Script for executing an AI Agent application
10-
With `llama.cpp` built and the Llama3.1 8B model downloaded, you are now ready to create a Python script to execute an AI agent Application:
10+
With `llama.cpp` built and the Llama3.1 8B model downloaded, you are now ready to create a Python script to execute an AI agent application:
1111

1212
Create a Python file named `agent.py` with the content shown below:
1313
```bash
@@ -156,5 +156,5 @@ def run_web_search_agent():
156156
if __name__ == '__main__':
157157
run_web_search_agent()
158158
```
159-
In the next section, you will inspect this script to understand how the LLM is configured and used to execute Agent tasks using this script. You will then proceed to executing and testing the AI agent.
159+
In the next section, you will inspect this script to understand how the LLM is configured and used to execute agent tasks. You will then proceed to executing and testing the AI agent.
160160

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/ai-agent.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,18 +8,18 @@ layout: learningpathall
88

99
## Overview of AI Agents
1010

11-
An AI agent as an integrated system that extends beyond basic text generation by augmenting Large Language Models (LLMs) with tools and domain knowledge.
11+
An AI agent is an integrated system that extends beyond basic text generation by augmenting Large Language Models (LLMs) with tools and domain knowledge.
1212

1313
Here’s a closer look at the underlying elements:
1414

15-
- **System**: Each AI agent functions as an interconnected ecosystem of components. Below is a list of key factors and components that affect performance:
15+
- **System**: Each AI agent functions as an interconnected ecosystem of components. Below is a list of key factors and components that affect system performance:
1616
- **Environment**: The domain in which the AI Agent operates. For instance, in a system that books travel itineraries, this might include airline reservation systems and hotel booking tools.
1717
- **Sensors**: The methods the AI agent uses to observe its environment. For a travel agent, these might be APIs that inform the agent about seat availability on flights or room occupancy in hotels.
1818
- **Actuators**: Ways the AI agent exerts influence within the environment. In the example of a travel agent, placing a booking or modifying an existing reservation illustrates how actuators function to enact changes within the environment.
1919

2020
- **Large Language Models**: While agents have long existed, LLMs enhance these systems with powerful language comprehension and data-processing capabilities.
2121
- **Action Execution**: Rather than just produce text, LLMs within an agent context interpret user instructions and interact with tools to achieve specific objectives.
22-
- **Tools**: The agent’s available toolkit depends on the software environment and developer-defined boundaries. In the travel agent example, these tools might be limited to flight and hotel reservation APIs.
22+
- **Tools**: The agent’s available toolkit depends on the software environment and developer-defined boundaries. In the travel agent example in this Learning Path, these tools might be limited to flight and hotel reservation APIs.
2323
- **Knowledge**: Beyond immediate data sources, the agent can fetch additional details - perhaps from databases or web services - for enhanced decision making.
2424

2525

@@ -36,7 +36,7 @@ AI Agents come in multiple forms. The table below provides an overview of some a
3636
| **Utility-Based Agents** | Use scoring or numerical metrics to compare and select actions that fulfill a goal. | Balances cost versus convenience when determining which flights or hotels to book. |
3737
| **Learning Agents** | Adapt over time by integrating lessons from previous feedback or experiences. | Adjusts future booking suggestions based on traveler satisfaction surveys. |
3838
| **Hierarchical Agents** | Split tasks into sub-tasks and delegate smaller pieces of work to subordinate agents.| Cancels a trip by breaking down the process into individual steps, such as canceling a flight, a hotel, and a car rental. |
39-
| **Multi-Agent Systems** | Involve multiple agents that may cooperate or compete to complete tasks. | Cooperative: Different agents each manage flights, accommodations, and excursions. Competitive: Several agents vie for limited rooms. |
39+
| **Multi-Agent Systems** | Involve multiple agents that might cooperate or compete to complete tasks. | Cooperative: Different agents each manage flights, accommodations, and excursions. Competitive: Several agents vie for limited rooms. |
4040

4141

4242
## Ideal Applications for AI Agents

content/learning-paths/servers-and-cloud-computing/ai-agent-on-cpu/set-up.md

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,11 +8,13 @@ layout: learningpathall
88

99
## Before you begin
1010

11-
This Learning Path demonstrates how to build an AI Agent Application using open-source Large Language Models (LLMs) optimized for Arm architecture. The AI Agent can use Large Language Models (LLMs) to perform actions by accessing tools and knowledge. The instructions in this Learning Path have been designed for Arm servers running Ubuntu 22.04 LTS. You need an Arm server instance with at least 4 cores and 16GB of memory to run this example. Configure disk storage up to at least 32 GB. The instructions have been tested on an AWS EC2 Graviton3 `m7g.xlarge` instance.
11+
This Learning Path demonstrates how to build an AI Agent Application using open-source LLMs optimized for Arm architecture. The AI Agent can use Large Language Models (LLMs) to perform actions by accessing tools and knowledge.
12+
13+
The instructions in this Learning Path have been designed for Arm servers running Ubuntu 22.04 LTS. You require an Arm server instance with at least 4 cores and 16GB of memory to run this example. Configure disk storage up to at least 32 GB. The instructions have been tested on an AWS EC2 Graviton3 `m7g.xlarge` instance.
1214

1315
## Overview
1416

15-
In this Learning Path, you learn how to build an AI Agent application using `llama-cpp-python` and `llama-cpp-agent`. `llama-cpp-python` is a Python binding for `llama.cpp` that enables efficient LLM inference on Arm CPUs and `llama-cpp-agent` provides an interface for processing text using agentic chains with tools.
17+
In this Learning Path, you will learn how to build an AI agent application using `llama-cpp-python`, and `llama-cpp-agent`. `llama-cpp-python` is a Python binding for `llama.cpp` that enables efficient LLM inference on Arm CPUs and `llama-cpp-agent` provides an interface for processing text using agentic chains with tools.
1618

1719
## Install Dependencies
1820

@@ -43,7 +45,7 @@ pip install llama-cpp-agent pydantic
4345
```
4446

4547

46-
## Download the pre-quantized Llama-3.1-8B LLM model from Hugging Face
48+
## Download the Pre-quantized Llama-3.1-8B LLM Model from Hugging Face
4749

4850
You are now ready to download the LLM.
4951

@@ -58,7 +60,7 @@ Install the `huggingface_hub` Python library using `pip`:
5860
```bash
5961
pip install huggingface_hub
6062
```
61-
You can now download the [pre-quantized Llama3.1 8B model](https://huggingface.co/cognitivecomputations/dolphin-2.9.4-llama3.1-8b-gguf) using the huggingface cli:
63+
You can now download the [pre-quantized Llama3.1 8B model](https://huggingface.co/cognitivecomputations/dolphin-2.9.4-llama3.1-8b-gguf) using the `huggingface-cli`:
6264

6365
```bash
6466
huggingface-cli download cognitivecomputations/dolphin-2.9.4-llama3.1-8b-gguf dolphin-2.9.4-llama3.1-8b-Q4_0.gguf --local-dir . --local-dir-use-symlinks False

0 commit comments

Comments
 (0)