feat(anthropic): Add proper tool calling data to Anthropic integration #4769

antonpirker · 2025-09-05T10:19:29Z

Format the response of the LLM (gen_ai.response.text) correctly. Not using the JSON but only use the actual text that was returned.
Add responses for tool calls (gen_ai.response.tool_calls) to the LLM spans.
Add results of tool calls to the request (gen_ai.request.messages).

Before:

After:

codecov · 2025-09-05T10:21:05Z

❌ 24 Tests Failed:

Tests completed	Failed	Passed	Skipped
23909	24	23885	2303

View the top 3 failed test(s) by shortest run time

tests.integrations.aws_lambda.test_aws_lambda::test_basic_exception

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_error_has_existing_trace_context[RaiseErrorPerformanceDisabled]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_error_has_existing_trace_context[RaiseErrorPerformanceEnabled]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_error_has_new_trace_context[RaiseErrorPerformanceDisabled]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_error_has_new_trace_context[RaiseErrorPerformanceEnabled]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_headers[empty dict headers]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_headers[empty list headers]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_headers[empty string headers]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_headers[no headers]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_headers[none headers]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_init_error

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as bool]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as dict]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as empty list]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as float]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as integer]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as list of dicts]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_non_dict_event[event as string]

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_request_data

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_span_origin

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_timeout_error

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_trace_continuation

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_traces_sampler_has_correct_sampling_context

Stack Traces | 0s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

tests.integrations.aws_lambda.test_aws_lambda::test_basic_no_exception

Stack Traces | 93.9s run time

.../integrations/aws_lambda/test_aws_lambda.py:70: in test_environment
    LocalLambdaStack.wait_for_stack()
.../integrations/aws_lambda/utils.py:221: in wait_for_stack
    raise TimeoutError(
E   TimeoutError: AWS SAM failed to start within 60 seconds. (Maybe Docker is not running?)

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}

sentry_sdk/integrations/anthropic.py

better handling of tools in messages

daef9a6

antonpirker requested a review from a team as a code owner September 5, 2025 10:19

This comment was marked as outdated.

Sign in to view

cleanup

bf5ec90

seer-by-sentry bot reviewed Sep 5, 2025

View reviewed changes

sentry_sdk/integrations/anthropic.py Outdated Show resolved Hide resolved

This comment was marked as outdated.

Sign in to view

antonpirker added 2 commits September 5, 2025 12:34

resilience

065e24e

Merge branch 'master' into antonpirker/anthropic-messages

1884221

antonpirker changed the title ~~Better handling of tool messages in Anthropic~~ feat(anthropic): Add propper tool calling data to Anthropic integration Sep 11, 2025

Merge branch 'master' into antonpirker/anthropic-messages

1e46e4c

antonpirker changed the title ~~feat(anthropic): Add propper tool calling data to Anthropic integration~~ feat(anthropic): Add proper tool calling data to Anthropic integration Sep 12, 2025

antonpirker added 3 commits September 12, 2025 09:32

update tests

8134240

Merge branch 'master' into antonpirker/anthropic-messages

8d27539

Merge branch 'master' into antonpirker/anthropic-messages

ee3f80a

sentrivana approved these changes Sep 12, 2025

View reviewed changes

antonpirker merged commit 398b7c4 into master Sep 12, 2025
134 of 137 checks passed

antonpirker deleted the antonpirker/anthropic-messages branch September 12, 2025 09:31

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(anthropic): Add proper tool calling data to Anthropic integration #4769

feat(anthropic): Add proper tool calling data to Anthropic integration #4769

antonpirker commented Sep 5, 2025 •

edited

Loading

Uh oh!

codecov bot commented Sep 5, 2025 •

edited

Loading

Uh oh!

This comment was marked as outdated.

Uh oh!

Uh oh!

This comment was marked as outdated.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

feat(anthropic): Add proper tool calling data to Anthropic integration #4769

feat(anthropic): Add proper tool calling data to Anthropic integration #4769

Conversation

antonpirker commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov bot commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

❌ 24 Tests Failed:

Uh oh!

This comment was marked as outdated.

Uh oh!

Uh oh!

This comment was marked as outdated.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

antonpirker commented Sep 5, 2025 •

edited

Loading

codecov bot commented Sep 5, 2025 •

edited

Loading