Skip to content

Conversation

@mrubens
Copy link
Collaborator

@mrubens mrubens commented Jan 31, 2025

o3-mini can stream


Important

Adds streaming support for o3-mini in createMessage() in openai-native.ts.

  • Behavior:
    • Adds streaming support for o3-mini in createMessage() in openai-native.ts.
    • Streams responses with type: "text" and type: "usage" for o3-mini.
  • Misc:
    • Removes o3-mini from non-streaming case in createMessage().

This description was created by Ellipsis for 7d28ff5. It will automatically update as commits are pushed.

@changeset-bot
Copy link

changeset-bot bot commented Jan 31, 2025

🦋 Changeset detected

Latest commit: 7d28ff5

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
roo-cline Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

}
break
}
case "o3-mini": {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider using helper functions for the repeated logic of handling the stream and yielding results. This will reduce redundancy and improve readability. This is from our Development Standards: https://www.notion.so/Development-Standards-59febcf8ead647fd9c2ec3f60c22f3df?pvs=4#11869ad2d5818094a05ef707e188c0d5

@mrubens mrubens merged commit 0c795ec into main Jan 31, 2025
6 checks passed
@mrubens mrubens deleted the fix_o3_streaming branch January 31, 2025 22:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants