-
Notifications
You must be signed in to change notification settings - Fork 125
Add Converse API support. DO NOT MERGE YET #1428
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
🦙 MegaLinter status: ❌ ERROR
See detailed report in MegaLinter reports |
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #1428 +/- ##
==========================================
+ Coverage 81.33% 81.36% +0.02%
==========================================
Files 208 208
Lines 23585 23660 +75
Branches 3719 3728 +9
==========================================
+ Hits 19184 19251 +67
- Misses 3144 3149 +5
- Partials 1257 1260 +3 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A couple things that need addressing but overall looks good. I'm going to try to run this manually next week to verify but these are just my thoughts from looking at the code changes.
): | ||
try: | ||
bedrock_attrs = {"model": model, "span_id": span_id, "trace_id": trace_id} | ||
if is_converse: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A couple thoughts on the design of this:
I wonder if there's a way you could move this if is_converse block into a request_extractor? Have you explored that at all/do you think that's worth exploring?
OR
Maybe converse should not use this extractor concept at all since it doesn't need to.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just ran this locally and it appears to be behaving as expected so all good from that side of things!
…ewrelic-python-agent into coverse-non-streaming-support
This PR adds support for the AWS Bedrock
Converse
operation.