Skip to content

[Tool Description] Improve Cosmos DB tool description for better LLM selection #822

@charris-msft

Description

@charris-msft

Problem

The current Cosmos DB tool description lacks the detail and clarity needed for optimal LLM tool selection, resulting in an estimated confidence score of ~0.3 (below target of ≥0.5).

Current Description Issues:

  • Missing usage guidance (when to use vs when not to use)
  • Limited context about Cosmos DB service and APIs
  • Vague description of available operations
  • Poor parameter explanation
  • Missing limitations/caveats
  • Formatting issues (missing space after period)
  • No mention of different API models (SQL, MongoDB, etc.)

Current Description

Cosmos DB operations - Commands for managing and querying Azure Cosmos DB resources. Includes operations for databases, containers, and document queries.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.

Suggested Improvement

Cosmos DB operations - Commands for managing and querying Azure Cosmos DB databases, containers, and documents across different API models including SQL API and MongoDB API. Use this tool when you need to list Cosmos DB accounts, create or manage databases and containers, execute SQL queries against documents, or retrieve database/container metadata and configurations. This tool supports operations for NoSQL document databases and is ideal for document storage and retrieval scenarios. Do not use this tool for relational database operations, Azure SQL Database management, or complex transaction processing - this tool focuses on Cosmos DB's NoSQL document and key-value operations. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different Cosmos DB operations and API models. Note that this tool requires appropriate Cosmos DB permissions and will only access resources within the authenticated user's scope.

Acceptance Criteria

  • Update tool description to include clear usage guidance
  • Explain Cosmos DB context and different API models
  • Clarify when NOT to use this tool (vs SQL databases)
  • Detail the specific operations available
  • Fix formatting issues
  • Achieve confidence score ≥0.5 in tool selection testing

Related: Tool description review for improved LLM selection accuracy

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

Untriaged

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions