Skip to content

[Tool Description] Improve Kusto tool description for better LLM selectionΒ #830

@charris-msft

Description

@charris-msft

Problem

The current Kusto tool description is functional but lacks the detail and clarity needed for optimal LLM tool selection. Estimated confidence score of ~0.5 (at target but could be improved for better precision).

Current Description Issues:

  • Missing usage guidance (when to use vs when not to use)
  • Limited context about Azure Data Explorer use cases
  • Poor parameter explanation
  • Missing relationship to other Azure analytics services
  • Formatting issues (missing space after period)
  • No mention of data types best suited for Kusto

Current Description

Kusto operations - Commands for managing and querying Azure Data Explorer (Kusto) resources. Includes operations for listing clusters and databases, executing KQL queries, retrieving table schemas, and working with Kusto data analytics workloads.This tool is a hierarchical MCP command router. Sub commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its args in "parameters". Set "learn=true" to discover available sub commands.

Suggested Improvement

Kusto operations - Commands for managing and querying Azure Data Explorer (Kusto) clusters for big data analytics, log analysis, and telemetry processing using KQL (Kusto Query Language). Use this tool when you need to list Data Explorer clusters and databases, execute KQL queries against large datasets, retrieve table schemas, analyze time-series data, or work with high-volume analytics workloads from IoT, applications, or infrastructure logs. This tool is ideal for complex analytics queries and data exploration scenarios. Do not use this tool for transactional database operations, simple key-value lookups, Azure SQL Database queries, or Azure Monitor Log Analytics workspace operations - use the appropriate database or monitor tools instead. This tool is a hierarchical MCP command router where sub-commands are routed to MCP servers that require specific fields inside the "parameters" object. To invoke a command, set "command" and wrap its arguments in "parameters". Set "learn=true" to discover available sub-commands for different Kusto cluster and query operations. Note that this tool requires appropriate Azure Data Explorer permissions and will only access clusters and data accessible to the authenticated user.

Acceptance Criteria

  • Update tool description to include clear usage guidance
  • Explain Azure Data Explorer's analytics and big data context
  • Clarify when NOT to use this tool (vs SQL, Monitor, etc.)
  • Detail the specific analytics operations available
  • Fix formatting issues
  • Achieve confidence score >0.6 in tool selection testing

Related: Tool description review for improved LLM selection accuracy

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

Untriaged

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions