Skip to content

Commit ff61fbf

Browse files
committed
Update Blog “llm-agentic-tool-mesh-orchestrating-agentic-tools-for-the-next-revolution”
1 parent 183b54e commit ff61fbf

File tree

1 file changed

+29
-27
lines changed

1 file changed

+29
-27
lines changed

content/blog/llm-agentic-tool-mesh-orchestrating-agentic-tools-for-the-next-revolution.md

Lines changed: 29 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: "LLM Agentic Tool Mesh: Orchestrating agentic tools for the next revolution"
2+
title: "LLM Agentic Tool Mesh: Orchestrating agentic tools for the AI revolution"
33
date: 2025-01-20T08:36:14.226Z
44
author: Antonio Fin
55
authorimage: /img/afin_photo.jpg
@@ -17,15 +17,15 @@ li {
1717
}
1818
</style>
1919

20-
In our previous blog posts, we delved into the [Chat Service](https://developer.hpe.com/blog/ll-mesh-exploring-chat-service-and-factory-design-pattern/), [Agent Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-harnessing-agent-services-and-multi-agent-ai-for-next-level-gen-ai/), and [RAG Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-empowering-gen-ai-with-retrieval-augmented-generation-rag/) of [LLM Agentic Tool Mesh open source project](https://github.com/HewlettPackard/llmesh). Today, we'll explore the System Services of LLM Agentic Tool Mesh that are essential for managing and orchestrating the mesh of agentic tools.
20+
In my previous blog posts, I dolve into the [Chat Service](https://developer.hpe.com/blog/ll-mesh-exploring-chat-service-and-factory-design-pattern/), [Agent Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-harnessing-agent-services-and-multi-agent-ai-for-next-level-gen-ai/), and [RAG Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-empowering-gen-ai-with-retrieval-augmented-generation-rag/) of [LLM Agentic Tool Mesh open source project](https://github.com/HewlettPackard/llmesh). Today, I'll explore the system services of LLM Agentic Tool Mesh, which are essential for managing and orchestrating the mesh of agentic tools.
2121

22-
We'll provide insights into these services, showcase an example of a Mesh available in the repository, discuss federated governance, and share our vision for the future evolution of the LLM Agentic Tool Mesh project.
22+
I'll provide insights into these services, showcase an example of a Mesh available in the repository, discuss federated governance, and share our vision for the future evolution of the LLM Agentic Tool Mesh project.
2323

2424
![](/img/mesh.png)
2525

26-
# Understanding the System Services
26+
# Understanding the system services
2727

28-
The System Services in LLM Agentic Tool Mesh are crucial for the seamless operation and orchestration of agentic tools and web applications. These services ensure consistency, ease of use, and flexibility across the platform. They include:
28+
The system services in LLM Agentic Tool Mesh are crucial for the seamless operation and orchestration of agentic tools and web applications. These services ensure consistency, ease of use, and flexibility across the platform. They include:
2929

3030
1. **Tool Client Service**
3131
2. **Tool Server Service**
@@ -38,8 +38,8 @@ The Tool Client Service enables developers to transform any code function into a
3838

3939
Key features:
4040

41-
* Decorator-based: Convert functions into tools using the `@AthonTool` decorator.
42-
* Seamless integration: Decorated functions are fully integrated into the LLM Agentic Tool Mesh platform.
41+
* Decorator-based: Convert functions into tools using the `@AthonTool` decorator
42+
* Seamless integration: Decorated functions are fully integrated into the LLM Agentic Tool Mesh platform
4343

4444
Example usage:
4545

@@ -64,8 +64,8 @@ The Tool Server Service provides the necessary infrastructure to manage and run
6464

6565
Key features:
6666

67-
* Tool discovery: Automatically discover tools within the platform.
68-
* Execution management: Manage the execution of tools, ensuring efficient operation.
67+
* Tool discovery: Automatically discover tools within the platform
68+
* Execution management: Manage the execution of tools, ensuring efficient operation
6969

7070
![](/img/tools.png)
7171

@@ -118,20 +118,20 @@ for tool in tool_repository.get_tools().tools:
118118

119119
# Building a mesh of LLM Agentic Tools
120120

121-
We have developed a series of web applications and tools, complete with examples, to demonstrate the capabilities of LLM Agentic Tool Mesh in out [GitHub repo](https://github.com/HewlettPackard/llmesh).
121+
We have developed a series of web applications and tools, complete with examples, to demonstrate the capabilities of LLM Agentic Tool Mesh in our [GitHub repo](https://github.com/HewlettPackard/llmesh).
122122

123-
Web Applications:
123+
Web applications:
124124

125-
* **Chatbot** (`examples/app_chatbot`): A chatbot capable of reasoning and invoking appropriate LLM tools to perform specific actions. You can configure the chatbot using files that define LLM Agentic Tool Mesh platform services, project settings, toolkits, and memory configurations. The web app orchestrates both local and remote LLM tools, allowing them to define their own HTML interfaces, supporting text, images, and code presentations.
126-
* **Admin panel** (`examples/app_backpanel`): An admin panel that enables the configuration of basic LLM tools to perform actions via LLM calls. It allows you to set the system prompt, select the LLM model, and define the LLM tool interface, simplifying the process of configuring LLM tool interfaces.
125+
* **Chatbot** (`examples/app_chatbot`): This is a chatbot capable of reasoning and invoking appropriate LLM tools to perform specific actions. You can configure the chatbot using files that define LLM Agentic Tool Mesh platform services, project settings, toolkits, and memory configurations. The web app orchestrates both local and remote LLM tools, allowing them to define their own HTML interfaces, supporting text, images, and code presentations.
126+
* **Admin panel** (`examples/app_backpanel`): There's an admin panel that enables the configuration of basic LLM tools to perform actions via LLM calls. It allows you to set the system prompt, select the LLM model, and define the LLM tool interface, simplifying the process of configuring LLM tool interfaces.
127127

128128
Tools:
129129

130-
* **Basic copywriter** (`examples/tool_copywriter`): A tool that rewrites text, providing explanations for enhancements and changes.
131-
* **Temperature finder** (`examples/tool_api`): Fetches and displays the current temperature for a specified location by utilizing a public API.
132-
* **Temperature analyzer** (`examples/tool_analyzer`): Generates code using a language model to analyze historical temperature data and create visual charts for better understanding
133-
* **Telco expert** (`examples/tool_rag`): A RAG tool that provides quick and accurate access to 5G specifications.
134-
* **OpenAPI manager** (`examples/tool_agents`): A multi-agent tool that reads OpenAPI documentation and provides users with relevant information based on their queries.
130+
* **Basic copywriter** (`examples/tool_copywriter`): This tool rewrites text, providing explanations for enhancements and changes.
131+
* **Temperature finder** (`examples/tool_api`): This tool fetches and displays the current temperature for a specified location by utilizing a public API.
132+
* **Temperature analyzer** (`examples/tool_analyzer`): Another tools generates code, using a language model to analyze historical temperature data and create visual charts for better understanding
133+
* **Telco expert** (`examples/tool_rag`): The RAG tool provides quick and accurate access to 5G specifications.
134+
* **OpenAPI manager** (`examples/tool_agents`): This multi-agent tool reads OpenAPI documentation and provides users with relevant information based on their queries.
135135

136136
## Running the examples
137137

@@ -148,11 +148,11 @@ In the LLM Agentic Tool Mesh platform, the management of LLM tools is decentrali
148148

149149
Key principles:
150150

151-
* **Interoperable standards**: Ensures all tools and services work together seamlessly while adhering to best practices.
152-
* **Ethical compliance**: Emphasizes minimizing biases, ensuring fairness, and upholding ethical principles across all AI tools and models.
151+
* **Interoperable standards**: Ensures all tools and services work together seamlessly while adhering to best practices
152+
* **Ethical compliance**: Emphasizes minimizing biases, ensuring fairness, and upholding ethical principles across all AI tools and models
153153
* **Security and privacy**: Maintains rigorous standards to protect data and ensure compliance with privacy regulations.
154-
* **Continuous improvement**: Encourages feedback and collaboration to refine governance practices.
155-
* **Automated governance**: Plans to extend code quality checks to enforce governance policies, ensuring comprehensive compliance across the platform.
154+
* **Continuous improvement**: Encourages feedback and collaboration to refine governance practices
155+
* **Automated governance**: Plans to extend code quality checks to enforce governance policies, ensuring comprehensive compliance across the platform
156156

157157
LLM Agentic Tool Mesh includes a dedicated repository containing text files that outline various policies and standards (`federated_governance/`). These documents cover essential areas such as LLM model usage, RAG processes, and more.
158158

@@ -162,26 +162,28 @@ The LLM Agentic Tool Mesh platform is evolving into a comprehensive solution, pr
162162

163163
When creating a new web app, you can build upon the existing examples. With all services fully parameterized, there is unparalleled flexibility to design diverse user experience panels. For instance, current examples include a chatbot as a user interface and an admin panel for configuring an LLM tool. Additionally, web apps can be developed to support deployment tasks or facilitate experiments aimed at optimizing service parameters for specific objectives.
164164

165-
Currently, the platform provides:
165+
Currently, the platform provides a user panel and a dvelopment panel.
166166

167167
**User panel**:
168168

169169
* Implemented features: This panel focuses on engaging with tools like Chat, RAG, and Agent services. It provides a user-friendly interface for interacting with these capabilities.
170-
* Future goals: Enrich the existing services, offering an even more seamless and feature-rich experience for end-users.
170+
* Future goals: We plan to enrich the existing services, offering an even more seamless and feature-rich experience for end-users.
171171

172172
**Development panel**:
173173

174174
* Implemented features: This panel has been partially tackled with the backpanel web app example, which allows users to runtime modify the basic copywriter agentic tool and the RAG tool.
175-
* Future goals: Add more system services to support development, including real-time LLM tuning and configuration.
175+
* Future goals: We aim to add more system services to support development, including real-time LLM tuning and configuration.
176+
177+
In the future, we hope to be able to offer a deployment panel and an experiment panel.
176178

177179
**Deployment panel (future)**:
178180

179181
* Purpose: This panel will focus on deploying the LLM Agentic Tool Mesh tools seamlessly across one or more clusters, enabling large-scale and distributed deployments.
180-
* Planned features: Tools for monitoring deployed tools, orchestrating distributed systems, and managing deployment pipelines.
182+
* Planned features: We hope to offer tools for monitoring deployed tools, orchestrating distributed systems, and managing deployment pipelines.
181183

182184
**Experiment Panel (Future)**:
183185

184-
* Purpose: Designed for tracking and managing experiments to optimize LLM tool performance and suitability.
186+
* Purpose: This panel will be designed to track and manage experiments to optimize LLM tool performance and suitability.
185187
* Planned features: This panel will allow users to try different configurations and compare outcomes, helping teams evaluate the most effective settings for their use cases.
186188

187189
![](/img/usage.png)

0 commit comments

Comments
 (0)