Asynchronous tools can now hand control back to the LLM before completion, streaming updates as they progress. Filler phrases can be used to break long silences during tool execution. This release also includes numerous smaller fixes and enhancements across various plugins and features.
First-class async tools are now available via ctx.update(), and acoustic fillers can be added during long tool execution with ctx.with_filler(). Audio and text output now flushes per FlushSentinel, and single_peer_connection is exposed in JobContext.connect. Fixed unhandled exception logging in fire-and-forget tasks, high-memory IPC warnings, empty message handling in OpenAI realtime chat, and a participant KeyError on quick reconnect.
Fixed a recorder close hang and corrupt frame splits, and a RecorderIO closure issue when session close is interrupted. IPC proc acquisition now retries when all in-flight spawns fail. Model literals for LLM, STT, and TTS have been updated with new models and options, and deployment environment is now sent in worker registration.
Added Cartesia ink-2 speech-to-text and a Respeecher TTS plugin. Fixed AgentSession.aclose() hanging during job shutdown, SIP call no-speech timer defer, function tool ordering, AWS tool block flattening, and OpenAI Realtime OPENAI_BASE_URL env var fallback. Also improved Google Plugins with cached_content option for context caching and updated SmallestAI TTS for Lightning v3.1 Pro with WebSocket streaming.
Added integration for Google AI Platform LLMs and support for streaming input_audio_transcription delta events in OpenAI realtime. Fixed multiple voice pipeline race conditions including a transcript leak between flush and clear_buffer on interrupt, user turn tracking during agent handoff, and STT pipeline reuse restrictions. Also added GnaniAI STT plugin, fade_in/fade_out to AudioConfig, and VAD reset support without stream close.
Added UserTurnLimitOptions to interrupt long user speech and AvatarMetrics to track join and playback latency. New features include multi-message generation per realtime response, GPT Realtime Whisper support in OpenAI STT, Perplexity Agent API (Responses) LLM, and Gemini 3.5 Flash model support. The mcp_servers parameter on Agent and AgentSession is deprecated.
Fixed Deepgram TTS websocket errors not being surfaced and realtime voice generation not canceling when speech is interrupted. Also added Speechmatics STT support with VAD, support for python -m livekit.agents.download asset fetching, Rime Coda model support, and inference.LLM.update_options for live model swaps.
Fixed a FishAudio TTS generation hang, a Google STT memory leak when no audio input is present, and a scheduling deadlock when a pipeline task crashes. Also added Perplexity LLM plugin, Rime WebSocket streaming TTS support, fine-grained VAD parameters for Sarvam STT, media resolution option to Gemini LLM, and DTMF and ringing timeout exposure on WarmTransferTask.
Refines default behavior for preemptive generation to better handle long or i...
Note
**livekit-agents 1.5 introduced many new features. You can check out the changelog [here](https://github.com/livekit/agents/releases/ta...
Note
**livekit-agents 1.5 introduced many new features. You can check out the changelog [here](https://github.com/livekit/agents/releases/ta...
The headline feature of v1.5.0: an audio-based ML model that distinguishes genuine user interru...
Patch Changes - Updated dependencies \[ , [ ](https://github.com/livekit/agents-js/commit/27de4099f0bd66aa02a5aa040f00767b8
LiveKit · Agents JSPatch Changes - Updated dependencies \[ , [ ](https://github.com/livekit/agents-js/commit/27de4099f0bd66aa02a5aa040f00767b8
LiveKit · Agents JSMinor Changes - 1216ded: Add full tool result payload support to . The callback now also receives server events, delivering the raw string…
ElevenLabs · Agents SDK (TypeScript)Build from 36f166ef55525202b86e7e4fd40f3f0373211b38
PostHog