Support for pluggable transports - AudioStream as an example

[bevenky]

Feature Type

Nice to have

Feature Description

Add support for pluggable transports, AudioStream as an example. This would allow AgentSession to accept audio input/output directly from:

E.g:

from livekit.agents import AgentSession, AudioStreamTransport

transport = AudioStreamTransport(
input_stream=websocket_audio_in, # async iterator of audio frames
output_stream=websocket_audio_out, # async callable to send audio frames
sample_rate=16000,
channels=1,
frame_duration_ms=20,
)

session = AgentSession(transport=transport)
session.start(agent=MyAgent())

Workarounds / Alternatives

No response

Additional Context

No response

[yepher]

Can you describe a use case where this would be needed or helpful?

[bevenky]

Essentially having varied transport adaptors like how pipecat does: https://docs.pipecat.ai/client/js/transports/transport - This allows devs to use the transport that works for them like webrtc/websocket etc. @yepher