You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
telemetry(amazonq): adding a new metric amazonq_invokeLLM for agentic chat (#1027)
## Problem
- IDE has `amazonq_toolUseSuggested` metric emitted per tool execution
but this count will be high in the future.
- No latency metrics for tool execution.
## Solution
- `amazonq_invokeLLM` is emitted per LLM call in the agentic loop, this
emits the list of toolName's, list of toolId's and list of tool
execution latencies.
```
{
"name": "amazonq_invokeLLM",
"description": "This metric is emitted per LLM call in the agentic loop with or without tool execution.",
"metadata": [
{
"type": "credentialStartUrl",
"required": false
},
{
"type": "cwsprChatConversationId"
},
{
"type": "cwsprChatConversationType"
},
{
"type": "cwsprToolName"
},
{
"type": "cwsprToolUseId"
},
{
"type": "enabled",
"required": false
},
{
"type": "languageServerVersion",
"required": false
},
{
"type": "latency",
"required": false
},
]
},
```
<!---
REMINDER:
- Read CONTRIBUTING.md first.
- Add test coverage for your changes.
- Link to related issues/commits.
- Testing: how did you test your changes?
- Screenshots if applicable
-->
## License
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
0 commit comments