Skip to content

Conversation

@chungjac
Copy link
Contributor

@chungjac chungjac commented Apr 27, 2025

Problem

  • We would like metrics based on these product requirement definitions:
    1. Command execution acceptance rate:
      • [#Commands that users click run on] / [#Commands generated that required user to click run on]
    2. Diff acceptance rate:
      • As all diffs are auto-accepted, the acceptance rate is calculated by: 1 - [#Diffs rejected] / [#Diffs generated]
      • Rejection is defined as user specifically pressing the Undo button
    3. Stop chat:
      • User specifically clicks Stop button
      • Implicit stop: user interrupts current ongoing message with new message

Solution

  • emit amazonq_interactWithAgenticChat metric

Testing

  • tested in kibana

License

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@chungjac chungjac requested a review from a team as a code owner April 27, 2025 19:13
@ashishrp-aws ashishrp-aws merged commit 9582275 into aws:main Apr 27, 2025
6 checks passed
@chungjac chungjac deleted the interact-agentic-chat branch June 4, 2025 01:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants