livekit-agents@1.0.14 — Agents (Python)

What's Changed

azure speech sdk version upgrade (>=1.41.0 to >=1.43.0) by @jayeshp19 in https://github.com/livekit/agents/pull/2008
fix: resolve type mismatch between _TurnDetector protocol and plugins by @kechako in https://github.com/livekit/agents/pull/2002
feat: enhance openai LLM metrics to include cached prompt tokens by @theomonnom in https://github.com/livekit/agents/pull/2013
delete livekit-plugins-rag by @theomonnom in https://github.com/livekit/agents/pull/1995
fix: add missing FunctionToolsExecutedEvent export by @mateuszkulpa in https://github.com/livekit/agents/pull/2016
detect leaked tasks on tests by @theomonnom in https://github.com/livekit/agents/pull/1993
toxic proxy & bring back tts tests by @theomonnom in https://github.com/livekit/agents/pull/1982
fix 11labs timeout & tests by @theomonnom in https://github.com/livekit/agents/pull/2017
Emit errors from open ai realtime model by @Shubhrakanti in https://github.com/livekit/agents/pull/1968
fix prompt_cached_tokens in llm metrics by @longcw in https://github.com/livekit/agents/pull/2024
simplify google tts voice params by @jayeshp19 in https://github.com/livekit/agents/pull/2025
fix gemini live interruption by @jayeshp19 in https://github.com/livekit/agents/pull/2029
support with_azure method in openai stt/tts by @jayeshp19 in https://github.com/livekit/agents/pull/2030
add bey avatar plugin by @longcw in https://github.com/livekit/agents/pull/2031
avoid duplicate room io initialization by @longcw in https://github.com/livekit/agents/pull/2037
add wait_for_participant as a function by @longcw in https://github.com/livekit/agents/pull/2039
fix realtime default turn detection and transcription for azure openai by @jayeshp19 in https://github.com/livekit/agents/pull/2041
allow overriding eou threshold by @jeradf in https://github.com/livekit/agents/pull/2035
Speechify TTS Plugin by @chaerla in https://github.com/livekit/agents/pull/2044
Readme updates by @davidzhao in https://github.com/livekit/agents/pull/2045
Fix dangling websocket connections by @ChenghaoMou in https://github.com/livekit/agents/pull/2027
move wait_for_participant to utils by @longcw in https://github.com/livekit/agents/pull/2047
add recovery method for OAI realtime text response by @longcw in https://github.com/livekit/agents/pull/2015
fix Speechify tests by @theomonnom in https://github.com/livekit/agents/pull/2051
fix openai timeout & tests by @theomonnom in https://github.com/livekit/agents/pull/2020
Speechify TTS Plugin Improvements by @chaerla in https://github.com/livekit/agents/pull/2056
support raw function descriptions by @theomonnom in https://github.com/livekit/agents/pull/2055
add bithuman avatar plugin by @longcw in https://github.com/livekit/agents/pull/2054
Misc fixes by @davidzhao in https://github.com/livekit/agents/pull/2049
fix discarded jobs when launching processes by @theomonnom in https://github.com/livekit/agents/pull/2059
fix generate_reply instructions by @theomonnom in https://github.com/livekit/agents/pull/2058
keep exception chaining by @theomonnom in https://github.com/livekit/agents/pull/1990
Use ogg by default for speechify by @davidzhao in https://github.com/livekit/agents/pull/2068
fix(gemini live): avoid duplicating input by @davidzhao in https://github.com/livekit/agents/pull/2069
fix realtime interruption for VAD turn detection by @longcw in https://github.com/livekit/agents/pull/2072
reset stt when clear user turn by @longcw in https://github.com/livekit/agents/pull/2070
Bug Fix - wrong transition to SPEAKING when the agent is in fact listening by @MajorTal in https://github.com/livekit/agents/pull/2075
support default arguments on function tools by @theomonnom in https://github.com/livekit/agents/pull/2076
store audio-synchronized transcript in chat_ctx when interrupted by @theomonnom in https://github.com/livekit/agents/pull/2071
support RunContext on raw function tools by @theomonnom in https://github.com/livekit/agents/pull/2077
Bug fix in agent_activity.py: user_state events were not fired by @MajorTal in https://github.com/livekit/agents/pull/2078
Support gemini thinking budget. by @pmaldonado in https://github.com/livekit/agents/pull/2060
publish legacy transcription event for avatar by @longcw in https://github.com/livekit/agents/pull/2074
merge anyOf optional unions to type list by @theomonnom in https://github.com/livekit/agents/pull/2079
fix optional arguments on function tools by @theomonnom in https://github.com/livekit/agents/pull/2080

New plugins

livekit-plugins-speechify — https://speechify.com/text-to-speech-api/
livekit-plugins-bithuman — https://bithuman.mintlify.app/api-reference/sdk/quick-start#1-livekit-agent
livekit-plugins-bey — https://docs.bey.dev/integration/livekit

New Contributors

@kechako made their first contribution in https://github.com/livekit/agents/pull/2002
@mateuszkulpa made their first contribution in https://github.com/livekit/agents/pull/2016
@chaerla made their first contribution in https://github.com/livekit/agents/pull/2044
@pmaldonado made their first contribution in https://github.com/livekit/agents/pull/2060

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.0.13...livekit-agents@1.0.14