Skip to content

Conversation

@laileni-aws
Copy link
Contributor

Problem

  • IDE has amazonq_toolUseSuggested metric emitted per tool execution but this count will be high in the future.
  • No latency metrics for tool execution.

Solution

  • amazonq_invokeLLM is emitted per LLM call in the agentic loop, this emits the list of toolName's, list of toolId's and list of tool execution latencies.
{
            "name": "amazonq_invokeLLM",
            "description": "This metric is emitted per LLM call in the agentic loop with or without tool execution.",
            "metadata": [
                {
                    "type": "credentialStartUrl",
                    "required": false
                },
                {
                    "type": "cwsprChatConversationId"
                },
                {
                    "type": "cwsprChatConversationType"
                },
                {
                    "type": "cwsprToolName"
                },
                {
                    "type": "cwsprToolUseId"
                },
                {
                    "type": "enabled",
                    "required": false
                },
                {
                    "type": "languageServerVersion",
                    "required": false
                },
                {
                    "type": "latency",
                    "required": false
                },
            ]
        },

License

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@laileni-aws laileni-aws requested a review from a team as a code owner May 14, 2025 05:42
@jpinkney-aws jpinkney-aws merged commit 3ed80f5 into aws:main May 14, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants