Expressive TTS mode; conversation-aware STT with keyterms

What's Changed

• fix(google): broaden _is_gemini_3_flash_model to cover all Gemini 3 Flash variants by @balazssandor in https://github.com/livekit/agents/pull/6210
• fix(assemblyai): respect mode preset for turn-silence; remap deprecated u3-pro by @dlange-aai in https://github.com/livekit/agents/pull/6220
• Move frame processor url/token/stream info to client sdk by @1egoman in https://github.com/livekit/agents/pull/5867
• fix(worker): exit when connection fails after max retries by @longcw in https://github.com/livekit/agents/pull/6103
• fix(voice): don't re-issue in-flight tool calls on a new turn by @longcw in https://github.com/livekit/agents/pull/6227
• (phonic): Use stream_ahead_of_real_time mode for Phonic WebSocket and sample rate 24000 by @qionghuang6 in https://github.com/livekit/agents/pull/6236
• fix(anthropic): use non-whitespace trailing dummy to satisfy provider validation by @JasonGordonD in https://github.com/livekit/agents/pull/6216
• fix(deepgram): sync missing STT/TTS API params, fix duplicate languages, add TTS model list by @Namit1867 in https://github.com/livekit/agents/pull/5362
• chore(deps): update dependency msgpack to v1.2.1 [security] by @renovate[bot] in https://github.com/livekit/agents/pull/6243
• docs: fix hotel_receptionist architecture section after refactor by @detail-app[bot] in https://github.com/livekit/agents/pull/6230
• fix(deepgram): remove duplicate redact param by @longcw in https://github.com/livekit/agents/pull/6245
• fix(openai): delete trimmed empty audio items by @he-yufeng in https://github.com/livekit/agents/pull/5887
• fix(openai realtime): discard orphaned response after interrupt or timeout by @longcw in https://github.com/livekit/agents/pull/6244
• fix CI due to realtime_model test by @davidzhao in https://github.com/livekit/agents/pull/6261
• fix: preserve transcription item id by @nightcityblade in https://github.com/livekit/agents/pull/6120
• fix(openai): skip realtime truncate when no audio was played fixes : #6157 by @ByteMaster-1 in https://github.com/livekit/agents/pull/6158
• feat(assemblyai): add language_code streaming param for language steering by @gsharp-aai in https://github.com/livekit/agents/pull/6219
• fix(xai): emit interim transcripts for in-progress status in realtime by @ByteMaster-1 in https://github.com/livekit/agents/pull/6272
• conversation-aware STT recognition (keyterms + chat context) by @longcw in https://github.com/livekit/agents/pull/6039
• Allow LemonSlice avatars to join third party meeting platforms by @aweitz in https://github.com/livekit/agents/pull/6233
• (xai realtime): pass voice parameter by @tinalenguyen in https://github.com/livekit/agents/pull/6276
• feat(certifi): user certifi as a fallback when system store is not present by @chenghao-mou in https://github.com/livekit/agents/pull/6231
• chore(eot): update log message about slow stt transcript by @chenghao-mou in https://github.com/livekit/agents/pull/6179
• fix(fallback_adapter): update stream start time offset in stt fallbackadapter by @chenghao-mou in https://github.com/livekit/agents/pull/6246
• feat(voice): stream tool call status events by @longcw in https://github.com/livekit/agents/pull/6100
• set default shutdown reason by @davidzhao in https://github.com/livekit/agents/pull/6284
• bump worker drain timeout to 1hr by @chenghao-mou in https://github.com/livekit/agents/pull/6286
• feat(rime): support speed_alpha for arcana and coda models by @balazssandor in https://github.com/livekit/agents/pull/6287
• feat(deepgram): apply Flux option updates in-band by @longcw in https://github.com/livekit/agents/pull/6277
• feat: realtime model fallback adapter by @longcw in https://github.com/livekit/agents/pull/6282
• update keyterm detection default model by @longcw in https://github.com/livekit/agents/pull/6289
• fix(eot): tighten eot cancellation by speech acitivity by @chenghao-mou in https://github.com/livekit/agents/pull/6274
• silero: use onnx when explicitely using silero.VAD.load() by @theomonnom in https://github.com/livekit/agents/pull/6290
• fix(openai): emit start/end of speech events for realtime STT AGT-3051 by @chenghao-mou in https://github.com/livekit/agents/pull/6297
• feat(smallestai): word_timestamps for TTS, v4 STT endpoints, eou_timeout fix by @harshitajain165 in https://github.com/livekit/agents/pull/5953
• fix(aws): nest endpointingSensitivity under turnDetectionConfiguration for Nova Sonic 2 by @St-Luciferr in https://github.com/livekit/agents/pull/6201
• switch to blingfire tokenizer by default by @davidzhao in https://github.com/livekit/agents/pull/6301
• feat(plugins-tavus): rename replica/persona to face/pal by @carolin-tavus in https://github.com/livekit/agents/pull/6239
• fix(openai): avoid mutating raw tool schemas for Responses by @VectorPeak in https://github.com/livekit/agents/pull/6305
• feat(openai): add temperature parameter to STT by @longcw in https://github.com/livekit/agents/pull/6307
• fix(liveavatar): preserve provider status errors by @VectorPeak in https://github.com/livekit/agents/pull/6306
• fix incorrect attribution of latency in tts.ttfb by @davidzhao in https://github.com/livekit/agents/pull/6300
• update livekit to 1.1.13 by @davidzhao in https://github.com/livekit/agents/pull/6311
• fix(voice): race between session.run and an in-flight AgentTask handoff by @longcw in https://github.com/livekit/agents/pull/6315
• fix(voice): resolve video task leak in AgentSession by @Mayank-MSJ-Singh in https://github.com/livekit/agents/pull/6318
• Add remove() method to ChatContext for flexible item removal by @3eid in https://github.com/livekit/agents/pull/5131
• fix: expose speech generation errors via SpeechHandle.exception() by @longcw in https://github.com/livekit/agents/pull/6304
• chore(deps): update actions/checkout action to v7 by @renovate[bot] in https://github.com/livekit/agents/pull/6325
• fix(test): stop false-positive "Audio data isn't PCM" failures in TTS tests by @u9g in https://github.com/livekit/agents/pull/6331
• feat(anam) add director notes config by @sr-anam in https://github.com/livekit/agents/pull/6267
• fix(aws): preserve image format for Bedrock images by @VectorPeak in https://github.com/livekit/agents/pull/6328
• (feat) 11Labs STT : Add enable_logging by @Ludobaka in https://github.com/livekit/agents/pull/6273
• feat: expressive mode by @tinalenguyen in https://github.com/livekit/agents/pull/6116
• Add connection pooling for xAI TTS by @godququ5-code in https://github.com/livekit/agents/pull/6317
• voice: output retries for run(output_type=...) by @theomonnom in https://github.com/livekit/agents/pull/6080
• disable openai sdk max_retries by @chenghao-mou in https://github.com/livekit/agents/pull/6341
• Allow direct image uploads for LemonSlice avatars by @jp-lemon in https://github.com/livekit/agents/pull/6343
• remove structured LLM output from voice pipeline by @tinalenguyen in https://github.com/livekit/agents/pull/6345
• remove livekit-blingfire (moved) by @theomonnom in https://github.com/livekit/agents/pull/6320
• (expressive mode): <expr/> expression marker dialect by @tinalenguyen in https://github.com/livekit/agents/pull/6347
• (expressive mode): fix markup tags impacting pacing by @tinalenguyen in https://github.com/livekit/agents/pull/6350
• feat(core): add plain_text_content property for ChatMessage by @chenghao-mou in https://github.com/livekit/agents/pull/6348
• fix(tts): restart ChunkedStream retries under a fresh request_id by @u9g in https://github.com/livekit/agents/pull/6346
• send ServerInfo to CLI host on start by @davidzhao in https://github.com/livekit/agents/pull/6260
• docs: fix livekit-durable README title copied from removed blingfire plugin by @detail-app[bot] in https://github.com/livekit/agents/pull/6355
• Feat/updating documentation for Gnani by @Gnani-AI-Mintlify in https://github.com/livekit/agents/pull/6004
• feat(soniox): support speed parameter in TTS by @yui0303 in https://github.com/livekit/agents/pull/6339
• fix(azure): recover from STT error cancellations instead of hanging by @apoorva-01 in https://github.com/livekit/agents/pull/6362
• fix: honor IGNORE_ON_ENTER for tools inside a Toolset by @longcw in https://github.com/livekit/agents/pull/6361
• fix: send DTMF to the active session room by @longcw in https://github.com/livekit/agents/pull/6360
• docs(soniox): add speed parameter to TTS example in README by @detail-app[bot] in https://github.com/livekit/agents/pull/6366
• (expressive mode): hide and remove from examples by @tinalenguyen in https://github.com/livekit/agents/pull/6370
• fix(core): flip text content fields AGT-3103 by @chenghao-mou in https://github.com/livekit/agents/pull/6353
• livekit-agents@1.6.5 by @github-actions[bot] in https://github.com/livekit/agents/pull/6371

New Contributors

• @balazssandor made their first contribution in https://github.com/livekit/agents/pull/6210
• @1egoman made their first contribution in https://github.com/livekit/agents/pull/5867
• @JasonGordonD made their first contribution in https://github.com/livekit/agents/pull/6216
• @ByteMaster-1 made their first contribution in https://github.com/livekit/agents/pull/6158
• @aweitz made their first contribution in https://github.com/livekit/agents/pull/6233
• @St-Luciferr made their first contribution in https://github.com/livekit/agents/pull/6201
• @carolin-tavus made their first contribution in https://github.com/livekit/agents/pull/6239
• @VectorPeak made their first contribution in https://github.com/livekit/agents/pull/6305
• @Mayank-MSJ-Singh made their first contribution in https://github.com/livekit/agents/pull/6318
• @3eid made their first contribution in https://github.com/livekit/agents/pull/5131
• @godququ5-code made their first contribution in https://github.com/livekit/agents/pull/6317
• @yui0303 made their first contribution in https://github.com/livekit/agents/pull/6339
• @apoorva-01 made their first contribution in https://github.com/livekit/agents/pull/6362

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.6.4...livekit-agents@1.6.5