-
Notifications
You must be signed in to change notification settings - Fork 315
Open
Description
Problem
The current Cosmos DB tool description lacks the detail and clarity needed for optimal LLM tool selection, resulting in an estimated confidence score of ~0.3 (below target of ≥0.5).
Current Description Issues:
- Missing usage guidance (when to use vs when not to use)
- Limited context about Cosmos DB service and APIs
- Vague description of available operations
- Poor parameter explanation
- Missing limitations/caveats
- Formatting issues (missing space after period)
- No mention of different API models (SQL, MongoDB, etc.)
Current Description
Cosmos DB operations - Commands for managing and querying Azure Cosmos DB resources. Includes operations for databases, containers, and document queries.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.
Suggested Improvement
Cosmos DB operations - Commands for managing and querying Azure Cosmos DB databases, containers, and documents across different API models including SQL API and MongoDB API. Use this tool when you need to list Cosmos DB accounts, create or manage databases and containers, execute SQL queries against documents, or retrieve database/container metadata and configurations. This tool supports operations for NoSQL document databases and is ideal for document storage and retrieval scenarios. Do not use this tool for relational database operations, Azure SQL Database management, or complex transaction processing - this tool focuses on Cosmos DB's NoSQL document and key-value operations. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different Cosmos DB operations and API models. Note that this tool requires appropriate Cosmos DB permissions and will only access resources within the authenticated user's scope.
Acceptance Criteria
- Update tool description to include clear usage guidance
- Explain Cosmos DB context and different API models
- Clarify when NOT to use this tool (vs SQL databases)
- Detail the specific operations available
- Fix formatting issues
- Achieve confidence score ≥0.5 in tool selection testing
Related: Tool description review for improved LLM selection accuracy
Copilot
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
Untriaged