Skip to content

[Tool Description] Improve Service Bus tool description for better LLM selection #844

@charris-msft

Description

@charris-msft

Problem

The current Service Bus tool description is functional but lacks the detail and clarity needed for optimal LLM tool selection. Estimated confidence score of ~0.5 (at target but could be improved for better precision).

Current Description Issues:

  • Missing usage guidance (when to use vs when not to use)
  • Limited context about messaging patterns and enterprise integration
  • Poor parameter explanation
  • Missing asynchronous messaging and decoupling context
  • Formatting issues (missing space after period)
  • No mention of messaging scenarios or enterprise communication patterns

Current Description

Service Bus operations - Commands for managing Azure Service Bus resources including queues, topics, and subscriptions. Includes operations for managing message queues, topic subscriptions, and retrieving details about Service Bus entities.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.

Suggested Improvement

Service Bus operations - Commands for managing Azure Service Bus messaging infrastructure including queues, topics, and subscriptions for reliable asynchronous communication and enterprise application integration. Use this tool when you need to manage message queues for point-to-point communication, configure topics and subscriptions for publish-subscribe messaging patterns, monitor message processing, or set up enterprise messaging scenarios for decoupled application architectures. This tool supports reliable messaging, dead letter handling, and enterprise integration patterns. Do not use this tool for real-time communication, direct API calls, database operations, or simple HTTP-based messaging - Service Bus is designed for asynchronous, reliable messaging between distributed applications and services. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different Service Bus entity management and messaging operations. Note that this tool requires appropriate Service Bus permissions and will only access messaging entities accessible to the authenticated user.

Acceptance Criteria

  • Update tool description to include clear usage guidance
  • Explain Service Bus messaging and enterprise integration context
  • Clarify when NOT to use this tool (vs real-time communication, APIs)
  • Detail the specific messaging operations available
  • Mention asynchronous messaging and decoupling benefits
  • Fix formatting issues
  • Achieve confidence score >0.6 in tool selection testing

Related: Tool description review for improved LLM selection accuracy

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

In Progress

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions