v0.3.0

NVIDIA Pipecat 0.3.0 (7 November 2025)

New Features

• Added WebRTC-based voice agent example and custom UI
• Nemo Agent Toolkit integration and Voice Agent example with Agentic AI
• Scripts for latency and throughput performance benchmarking for Voice Agents
• Support for Dynamic LLM prompt ingestion and TTS Voice selection using WebRTC UI
• Full-Duplex-Bench evaluation inference client script
• BlingFireTextAggregator for TTS Service
• Added steps for LLM deployment with KV Cache support

Improvements

• Updated pipecat to version 0.0.85
• Renamed GitHub repository to voice-agent-examples
• Switched to Magpie TTS Multilingual model
• Hardcoded NIM version tags in examples

Fixed

• Fixed user transcriptions and Docker Compose volume issues
• Split long TTS sentences to handle Riva TTS character limit error

Removed

• Removed Animation and Audio2Face support
• Removed ACE naming references

v0.2.0

NVIDIA Pipecat 0.2.0 (17 June 2025)

New Features

• Support for deepseek, mistral-ai, and llama-nemotron models in Nvidia LLM Service
• Support for BotSpeakingFrame in animation graph service

Improvements

• Upgraded Riva Client version to 2.20.0
• Upgraded to pipecat 0.0.68
• Improved animation graph stream handling
• Improved task cancellation support in NVIDIA LLM and NVIDIA RAG Service

Fixed

• Fixed transcription synchronization for multiple final ASR transcripts
• Fixed edge case where the mouth of the avatar would not close
• Fixed animation stream handling for broken streams
• Fixed Elevenlabs edge case issues with multi-lingual use cases
• Fixed chunk truncation issues in RAG Service
• Fixed dangling tasks and pipeline cleanup issues

v0.1.0

NVIDIA Pipecat 0.1.0 (23 April 2025)

The NVIDIA Pipecat library augments the Pipecat framework by adding additional frame processors and services, as well as new multimodal frames to enhance avatar interactions. This is the first release of the NVIDIA Pipecat library.

New Features

• Added Pipecat services for Riva ASR (Automatic Speech Recognition), Riva TTS (Text to Speech), and Riva NMT (Neural Machine Translation) models.
• Added Pipecat frames, processors, and services to support multimodal avatar interactions and use cases. This includes Audio2Face3DService, AnimationGraphService, FacialGestureProviderProcessor, and PostureProviderProcessor.
• Added ACETransport, which is specifically designed to support integration with existing ACE microservices. This includes a FastAPI-based HTTP and WebSocket server implementation compatible with ACE.
• Added NvidiaLLMService for NIM LLM models and NvidiaRAGService for the NVIDIA RAG Blueprint.
• Added UserTranscriptSynchronization processor for user speech transcripts and BotTranscriptSynchronization processor for synchronizing bot transcripts with bot audio playback.
• Added custom context aggregators and processors to enable Speculative Speech Processing to reduce latency.
• Added UserPresence, Proactivity, and AcknowledgementProcessor frame processors to improve human-bot interactions.
• Released source code for the voice assistant example using nvidia-pipecat, along with the pipecat-ai library service, to showcase NVIDIA services with ACETransport.

Improvements

• Added ElevenLabsTTSServiceWithEndOfSpeech, an extended version of the ElevenLabs TTS service with end-of-speech events for usage in avatar interactions.