Skip to content

test: add regression test for issue #181 (tool response for image)#371

Merged
robert-j-y merged 5 commits intomainfrom
devin/1769563140-issue-181-tool-image-test
Jan 28, 2026
Merged

test: add regression test for issue #181 (tool response for image)#371
robert-j-y merged 5 commits intomainfrom
devin/1769563140-issue-181-tool-image-test

Conversation

@robert-j-y
Copy link
Contributor

@robert-j-y robert-j-y commented Jan 28, 2026

Description

Adds a regression test for issue #181 ("tool response for image not working") following the e2e/issues/ pattern established in PR #369.

Test coverage (5 test cases):

  • Tool result with content type containing base64 image data (file-data)
  • Tool result with content type containing image URL (file-url)
  • Tool result with file-data type reproducing issue tool response for image not working #181 scenario (AI SDK v3 format)
  • Text-only tool results (baseline)
  • JSON tool results (baseline)

The test documents the observed behavior: tool results with multimodal content (images) are JSON.stringified.

Updates since last revision

  • Removed root cause analysis from test comments per review feedback - test now only documents known facts (reported behavior and observed behavior)
  • Uses AI SDK v3 format (type: "file-data") instead of V2 type: "media" format from the original issue

Human Review Checklist

  • Verify the test accurately reproduces the issue tool response for image not working #181 scenario
  • Confirm the test assertions correctly document the stringification behavior
  • Note: This is a unit test placed in e2e/issues/ to follow the issue regression test pattern

Checklist

  • I have run pnpm stylecheck and pnpm typecheck
  • I have run pnpm test and all tests pass
  • I have added tests for my changes (if applicable)
  • I have updated documentation (if applicable)

Changeset

  • I have run pnpm changeset to create a changeset file

Note: Empty changeset used since this is a test-only change that doesn't need a release.


Link to Devin run: https://app.devin.ai/sessions/b5fe98b56d854923975d83d933cdbf45
Requested by: Robert Yeakel (@robert-j-y)

devin-ai-integration bot and others added 5 commits January 28, 2026 01:20
Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>
Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>
Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>
Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>
Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>
@robert-j-y robert-j-y merged commit b57ec9d into main Jan 28, 2026
2 checks passed
@robert-j-y robert-j-y deleted the devin/1769563140-issue-181-tool-image-test branch January 28, 2026 02:24
kesavan-byte pushed a commit to osm-API/ai-sdk-provider that referenced this pull request Feb 13, 2026
… for image) (OpenRouterTeam#371)

* test: add regression test for issue OpenRouterTeam#181 (tool response for image)

Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>

* test: add image-data type test case for issue OpenRouterTeam#181

Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>

* test: use exact format from original issue OpenRouterTeam#181 (type: media)

Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>

* test: use AI SDK v3 file-data format for issue OpenRouterTeam#181 regression test

Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>

* test: remove root cause analysis from issue OpenRouterTeam#181 test comments

Co-Authored-By: Robert Yeakel <robert.yeakel@openrouter.ai>

---------

Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments