You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/blog/llm-agentic-tool-mesh-orchestrating-agentic-tools-for-the-next-revolution.md
+29-27Lines changed: 29 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
title: "LLM Agentic Tool Mesh: Orchestrating agentic tools for the next revolution"
2
+
title: "LLM Agentic Tool Mesh: Orchestrating agentic tools for the AI revolution"
3
3
date: 2025-01-20T08:36:14.226Z
4
4
author: Antonio Fin
5
5
authorimage: /img/afin_photo.jpg
@@ -17,15 +17,15 @@ li {
17
17
}
18
18
</style>
19
19
20
-
In our previous blog posts, we delved into the [Chat Service](https://developer.hpe.com/blog/ll-mesh-exploring-chat-service-and-factory-design-pattern/), [Agent Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-harnessing-agent-services-and-multi-agent-ai-for-next-level-gen-ai/), and [RAG Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-empowering-gen-ai-with-retrieval-augmented-generation-rag/) of [LLM Agentic Tool Mesh open source project](https://github.com/HewlettPackard/llmesh). Today, we'll explore the System Services of LLM Agentic Tool Mesh that are essential for managing and orchestrating the mesh of agentic tools.
20
+
In my previous blog posts, I dolve into the [Chat Service](https://developer.hpe.com/blog/ll-mesh-exploring-chat-service-and-factory-design-pattern/), [Agent Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-harnessing-agent-services-and-multi-agent-ai-for-next-level-gen-ai/), and [RAG Service](https://developer.hpe.com/blog/llm-agentic-tool-mesh-empowering-gen-ai-with-retrieval-augmented-generation-rag/) of [LLM Agentic Tool Mesh open source project](https://github.com/HewlettPackard/llmesh). Today, I'll explore the system services of LLM Agentic Tool Mesh, which are essential for managing and orchestrating the mesh of agentic tools.
21
21
22
-
We'll provide insights into these services, showcase an example of a Mesh available in the repository, discuss federated governance, and share our vision for the future evolution of the LLM Agentic Tool Mesh project.
22
+
I'll provide insights into these services, showcase an example of a Mesh available in the repository, discuss federated governance, and share our vision for the future evolution of the LLM Agentic Tool Mesh project.
23
23
24
24

25
25
26
-
# Understanding the System Services
26
+
# Understanding the system services
27
27
28
-
The System Services in LLM Agentic Tool Mesh are crucial for the seamless operation and orchestration of agentic tools and web applications. These services ensure consistency, ease of use, and flexibility across the platform. They include:
28
+
The system services in LLM Agentic Tool Mesh are crucial for the seamless operation and orchestration of agentic tools and web applications. These services ensure consistency, ease of use, and flexibility across the platform. They include:
29
29
30
30
1.**Tool Client Service**
31
31
2.**Tool Server Service**
@@ -38,8 +38,8 @@ The Tool Client Service enables developers to transform any code function into a
38
38
39
39
Key features:
40
40
41
-
* Decorator-based: Convert functions into tools using the `@AthonTool` decorator.
42
-
* Seamless integration: Decorated functions are fully integrated into the LLM Agentic Tool Mesh platform.
41
+
* Decorator-based: Convert functions into tools using the `@AthonTool` decorator
42
+
* Seamless integration: Decorated functions are fully integrated into the LLM Agentic Tool Mesh platform
43
43
44
44
Example usage:
45
45
@@ -64,8 +64,8 @@ The Tool Server Service provides the necessary infrastructure to manage and run
64
64
65
65
Key features:
66
66
67
-
* Tool discovery: Automatically discover tools within the platform.
68
-
* Execution management: Manage the execution of tools, ensuring efficient operation.
67
+
* Tool discovery: Automatically discover tools within the platform
68
+
* Execution management: Manage the execution of tools, ensuring efficient operation
69
69
70
70

71
71
@@ -118,20 +118,20 @@ for tool in tool_repository.get_tools().tools:
118
118
119
119
# Building a mesh of LLM Agentic Tools
120
120
121
-
We have developed a series of web applications and tools, complete with examples, to demonstrate the capabilities of LLM Agentic Tool Mesh in out[GitHub repo](https://github.com/HewlettPackard/llmesh).
121
+
We have developed a series of web applications and tools, complete with examples, to demonstrate the capabilities of LLM Agentic Tool Mesh in our[GitHub repo](https://github.com/HewlettPackard/llmesh).
122
122
123
-
Web Applications:
123
+
Web applications:
124
124
125
-
***Chatbot** (`examples/app_chatbot`): A chatbot capable of reasoning and invoking appropriate LLM tools to perform specific actions. You can configure the chatbot using files that define LLM Agentic Tool Mesh platform services, project settings, toolkits, and memory configurations. The web app orchestrates both local and remote LLM tools, allowing them to define their own HTML interfaces, supporting text, images, and code presentations.
126
-
***Admin panel** (`examples/app_backpanel`): An admin panel that enables the configuration of basic LLM tools to perform actions via LLM calls. It allows you to set the system prompt, select the LLM model, and define the LLM tool interface, simplifying the process of configuring LLM tool interfaces.
125
+
***Chatbot** (`examples/app_chatbot`): This is a chatbot capable of reasoning and invoking appropriate LLM tools to perform specific actions. You can configure the chatbot using files that define LLM Agentic Tool Mesh platform services, project settings, toolkits, and memory configurations. The web app orchestrates both local and remote LLM tools, allowing them to define their own HTML interfaces, supporting text, images, and code presentations.
126
+
***Admin panel** (`examples/app_backpanel`): There's an admin panel that enables the configuration of basic LLM tools to perform actions via LLM calls. It allows you to set the system prompt, select the LLM model, and define the LLM tool interface, simplifying the process of configuring LLM tool interfaces.
127
127
128
128
Tools:
129
129
130
-
***Basic copywriter** (`examples/tool_copywriter`): A tool that rewrites text, providing explanations for enhancements and changes.
131
-
***Temperature finder** (`examples/tool_api`): Fetches and displays the current temperature for a specified location by utilizing a public API.
132
-
***Temperature analyzer** (`examples/tool_analyzer`): Generates code using a language model to analyze historical temperature data and create visual charts for better understanding
133
-
***Telco expert** (`examples/tool_rag`): A RAG tool that provides quick and accurate access to 5G specifications.
134
-
***OpenAPI manager** (`examples/tool_agents`): A multi-agent tool that reads OpenAPI documentation and provides users with relevant information based on their queries.
130
+
***Basic copywriter** (`examples/tool_copywriter`): This tool rewrites text, providing explanations for enhancements and changes.
131
+
***Temperature finder** (`examples/tool_api`): This tool fetches and displays the current temperature for a specified location by utilizing a public API.
132
+
***Temperature analyzer** (`examples/tool_analyzer`): Another tools generates code, using a language model to analyze historical temperature data and create visual charts for better understanding
133
+
***Telco expert** (`examples/tool_rag`): The RAG tool provides quick and accurate access to 5G specifications.
134
+
***OpenAPI manager** (`examples/tool_agents`): This multi-agent tool reads OpenAPI documentation and provides users with relevant information based on their queries.
135
135
136
136
## Running the examples
137
137
@@ -148,11 +148,11 @@ In the LLM Agentic Tool Mesh platform, the management of LLM tools is decentrali
148
148
149
149
Key principles:
150
150
151
-
***Interoperable standards**: Ensures all tools and services work together seamlessly while adhering to best practices.
152
-
***Ethical compliance**: Emphasizes minimizing biases, ensuring fairness, and upholding ethical principles across all AI tools and models.
151
+
***Interoperable standards**: Ensures all tools and services work together seamlessly while adhering to best practices
152
+
***Ethical compliance**: Emphasizes minimizing biases, ensuring fairness, and upholding ethical principles across all AI tools and models
153
153
***Security and privacy**: Maintains rigorous standards to protect data and ensure compliance with privacy regulations.
154
-
***Continuous improvement**: Encourages feedback and collaboration to refine governance practices.
155
-
***Automated governance**: Plans to extend code quality checks to enforce governance policies, ensuring comprehensive compliance across the platform.
154
+
***Continuous improvement**: Encourages feedback and collaboration to refine governance practices
155
+
***Automated governance**: Plans to extend code quality checks to enforce governance policies, ensuring comprehensive compliance across the platform
156
156
157
157
LLM Agentic Tool Mesh includes a dedicated repository containing text files that outline various policies and standards (`federated_governance/`). These documents cover essential areas such as LLM model usage, RAG processes, and more.
158
158
@@ -162,26 +162,28 @@ The LLM Agentic Tool Mesh platform is evolving into a comprehensive solution, pr
162
162
163
163
When creating a new web app, you can build upon the existing examples. With all services fully parameterized, there is unparalleled flexibility to design diverse user experience panels. For instance, current examples include a chatbot as a user interface and an admin panel for configuring an LLM tool. Additionally, web apps can be developed to support deployment tasks or facilitate experiments aimed at optimizing service parameters for specific objectives.
164
164
165
-
Currently, the platform provides:
165
+
Currently, the platform provides a user panel and a dvelopment panel.
166
166
167
167
**User panel**:
168
168
169
169
* Implemented features: This panel focuses on engaging with tools like Chat, RAG, and Agent services. It provides a user-friendly interface for interacting with these capabilities.
170
-
* Future goals: Enrich the existing services, offering an even more seamless and feature-rich experience for end-users.
170
+
* Future goals: We plan to enrich the existing services, offering an even more seamless and feature-rich experience for end-users.
171
171
172
172
**Development panel**:
173
173
174
174
* Implemented features: This panel has been partially tackled with the backpanel web app example, which allows users to runtime modify the basic copywriter agentic tool and the RAG tool.
175
-
* Future goals: Add more system services to support development, including real-time LLM tuning and configuration.
175
+
* Future goals: We aim to add more system services to support development, including real-time LLM tuning and configuration.
176
+
177
+
In the future, we hope to be able to offer a deployment panel and an experiment panel.
176
178
177
179
**Deployment panel (future)**:
178
180
179
181
* Purpose: This panel will focus on deploying the LLM Agentic Tool Mesh tools seamlessly across one or more clusters, enabling large-scale and distributed deployments.
180
-
* Planned features: Tools for monitoring deployed tools, orchestrating distributed systems, and managing deployment pipelines.
182
+
* Planned features: We hope to offer tools for monitoring deployed tools, orchestrating distributed systems, and managing deployment pipelines.
181
183
182
184
**Experiment Panel (Future)**:
183
185
184
-
* Purpose: Designed for tracking and managing experiments to optimize LLM tool performance and suitability.
186
+
* Purpose: This panel will be designed to track and manage experiments to optimize LLM tool performance and suitability.
185
187
* Planned features: This panel will allow users to try different configurations and compare outcomes, helping teams evaluate the most effective settings for their use cases.
0 commit comments