Skip to content

brianyin/ajs-322-openai-half-duplex-mode #814

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 11 commits into
base: main
Choose a base branch
from
Open

brianyin/ajs-322-openai-half-duplex-mode #814

wants to merge 11 commits into from

Conversation

@toubatbrian
Copy link
Contributor

@toubatbrian toubatbrian commented Nov 7, 2025 •
edited
Loading

Allow openai realtime model to have text output piped with a custom TTS model

@changeset-bot
Copy link

changeset-bot bot commented Nov 7, 2025 •
edited
Loading

🦋 Changeset detected

Latest commit: cd36c22

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 14 packages
Name Type
@livekit/agents-plugin-google Patch
@livekit/agents-plugin-openai Patch
@livekit/agents Patch
@livekit/agents-plugin-anam Patch
@livekit/agents-plugin-cartesia Patch
@livekit/agents-plugin-elevenlabs Patch
@livekit/agents-plugin-neuphonic Patch
@livekit/agents-plugin-resemble Patch
@livekit/agents-plugin-rime Patch
@livekit/agents-plugin-bey Patch
@livekit/agents-plugin-deepgram Patch
@livekit/agents-plugin-livekit Patch
@livekit/agents-plugin-silero Patch
@livekit/agents-plugins-test Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@toubatbrian toubatbrian changed the title brianyin/ajs-322-openai-half-duplex-mode [draft] brianyin/ajs-322-openai-half-duplex-mode Nov 7, 2025
@toubatbrian toubatbrian changed the title [draft] brianyin/ajs-322-openai-half-duplex-mode brianyin/ajs-322-openai-half-duplex-mode Nov 7, 2025
@samuelcastro
Copy link

samuelcastro commented Nov 7, 2025 •
edited
Loading

@Shubhrakanti @theomonnom Any idea when we could get this reviewed and deployed? This is blocking us atm. Thank you!

@samuelcastro
Copy link

samuelcastro commented Nov 8, 2025

@toubatbrian I tested this changes and initially it worked just fine (with some latency) but after follow up questions the agent remains silent, my logs:

{"level":40,"time":1762644702889,"pid":63178,"hostname":"Sams-MacBook-Pro.local","msg":"SegmentSynchronizerImpl text marked as ended in capture text, rotating segment"}
{"level":50,"time":1762644703046,"pid":63178,"hostname":"Sams-MacBook-Pro.local","msg":"Error in SynthesizeStream"}
{"level":30,"time":1762644703049,"pid":63178,"hostname":"Sams-MacBook-Pro.local","ttftMs":302,"input_tokens":854,"cached_input_tokens":832,"output_tokens":17,"total_tokens":871,"tokens_per_second":36.48,"msg":"RealtimeModel metrics"}
{"level":40,"time":1762644715328,"pid":63164,"hostname":"Sams-MacBook-Pro.local","msg":"job is unresponsive"}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Shubhrakanti Shubhrakanti Awaiting requested review from Shubhrakanti

@theomonnom theomonnom Awaiting requested review from theomonnom

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@toubatbrian @samuelcastro