Skip to content

Conversation

@chungjac
Copy link
Contributor

@chungjac chungjac commented May 13, 2025

Problem

  • The following are new science requirements:
    • In the new agentic chat after a user types a message, it may trigger multiple LLM calls, but we only store the final LLM requestID (cwsprChatMessageId), which is the one that generates the response shown to the user. Earlier LLM calls in the sequence, which handle internal processing and aren't visible to users, are not currently emitted.

    • We currently emit the LLM interaction events, but we lose emission of the associated LLM/Tool RequestID’s that led to the user interaction event (ie we don’t know which LLM requests the user click stop button, we don’t know which write tool ID the user chose to undo).

Solution

  • Emit all LLM RequestIDs in the order that these requests were made in amazonq_addMessage
    • As the list of RequestIDs may be long, will look into the max char limit of a field in kibana
  • Emit Tool/LLM requestIDs related to User Interaction Events in amazonq_interactWithAgenticChat

License

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@chungjac chungjac marked this pull request as ready for review May 13, 2025 14:53
@chungjac chungjac requested a review from a team as a code owner May 13, 2025 14:53
@chungjac chungjac force-pushed the request-ids branch 5 times, most recently from ff3aa58 to 53b8ef3 Compare May 13, 2025 19:06
@chungjac chungjac requested a review from justinmk3 May 13, 2025 21:27
@justinmk3 justinmk3 merged commit 520ce39 into aws:main May 13, 2025
5 checks passed
jpinkney-aws pushed a commit to aws/aws-toolkit-vscode that referenced this pull request May 14, 2025
## Problem
- Added new metrics in aws-toolkit-common package:
aws/aws-toolkit-common#1024

## Solution
- Consume latest version of aws-toolkit-common package



---

- Treat all work as PUBLIC. Private `feature/x` branches will not be
squash-merged at release time.
- Your code changes must meet the guidelines in
[CONTRIBUTING.md](https://github.com/aws/aws-toolkit-vscode/blob/master/CONTRIBUTING.md#guidelines).
- License: I confirm that my contribution is made under the terms of the
Apache 2.0 license.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants