LiveKit/Agents (Python)

Releases14Avg5/moVersionslivekit-agents@1.3.12 → livekit-agents@1.5.4

What's Changed

fix user transcription forwarding order by @longcw in https://github.com/livekit/agents/pull/2279
Update README.md by @Bill-Niz in https://github.com/livekit/agents/pull/2299
streaming for google tts by @jayeshp19 in https://github.com/livekit/agents/pull/2143
openai: switch to mp3 encoding by default by @davidzhao in https://github.com/livekit/agents/pull/2306
aws: fixed STT error at end of session by @davidzhao in https://github.com/livekit/agents/pull/2297
fix AudioByteStream for multi channels by @longcw in https://github.com/livekit/agents/pull/2307
avatar runner publish audio/video tracks until first frame pushed by @longcw in https://github.com/livekit/agents/pull/2308
push a silent audio frame when input stream closed by @longcw in https://github.com/livekit/agents/pull/2309
Add support for decoding preconnect buffer by @lukasIO in https://github.com/livekit/agents/pull/2311
added deepwiki badge for weekly repo refresh by @nischalj10 in https://github.com/livekit/agents/pull/2296
openai: pass tool choice to session initialization by @davidzhao in https://github.com/livekit/agents/pull/2316
update text-only example to show generate_reply usage by @davidzhao in https://github.com/livekit/agents/pull/2317
updates to readme by @davidzhao in https://github.com/livekit/agents/pull/2318
add pre-connected audio buffer by @longcw in https://github.com/livekit/agents/pull/2171

New Contributors

@Bill-Niz made their first contribution in https://github.com/livekit/agents/pull/2299
@nischalj10 made their first contribution in https://github.com/livekit/agents/pull/2296

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.0.21...livekit-agents@1.0.22

What's Changed

debug QOL by @theomonnom in https://github.com/livekit/agents/pull/2150
use the forkserver on Linux by default by @theomonnom in https://github.com/livekit/agents/pull/2238
update to use property. Also make consistent by @milo157 in https://github.com/livekit/agents/pull/2236
livekit-plugins-aws: update the dependencies to allow for versions greater than specified version by @mike-r-mclaughlin in https://github.com/livekit/agents/pull/2244
fix quick rotation when flush with empty audio by @longcw in https://github.com/livekit/agents/pull/2251
add image_encode_options for google realtime model by @longcw in https://github.com/livekit/agents/pull/2249
Gemini Live improvements & bugfixes by @davidzhao in https://github.com/livekit/agents/pull/2247
11labs: improve resilience, do not fail when unexpected payload is received by @davidzhao in https://github.com/livekit/agents/pull/2255
feat: support cached prompt metrics for Gemini LLM by @mateuszkulpa in https://github.com/livekit/agents/pull/2256
fix google-cloud-texttospeech and anthropic min versions by @longcw in https://github.com/livekit/agents/pull/2268
fix raw function tool for google gemini by @longcw in https://github.com/livekit/agents/pull/2270
support simple word and sentence split for character-based language by @longcw in https://github.com/livekit/agents/pull/2263
remove leading whitespace from gemini user transcripts by @davidzhao in https://github.com/livekit/agents/pull/2254
deepgram: default to aura-2 for TTS by @davidzhao in https://github.com/livekit/agents/pull/2272
add realtime model metrics by @longcw in https://github.com/livekit/agents/pull/2275
revert buffer changes to AudioStreamDecoder by @davidzhao in https://github.com/livekit/agents/pull/2286
feat: Add max_completion_tokens parameter to OpenAI LLM by @dorlanpabon in https://github.com/livekit/agents/pull/2258
fix gather not retrieved error in stt by @longcw in https://github.com/livekit/agents/pull/2276
correctly pass timeout as connect timeout instead of total by @davidzhao in https://github.com/livekit/agents/pull/2285
Partial fix for Neuphonic bug detailed in issue #2281. by @adnansiddiquei in https://github.com/livekit/agents/pull/2282
Fix Neuphonic CI Tests. by @adnansiddiquei in https://github.com/livekit/agents/pull/2287
feat: allow to switch between Gemini and Vertex AI using env vars by @mateuszkulpa in https://github.com/livekit/agents/pull/2292

Full Changelog: https://github.com/livekit/agents/compare/livekit-agent@1.0.20...livekit-agents@1.0.21

What's Changed

google stt: support cofigurable streaming by @jayeshp19 in https://github.com/livekit/agents/pull/2192
fix google llm: single enum value validation error by @jayeshp19 in https://github.com/livekit/agents/pull/2196
correctly pass in spoken_punctuation param for Google STT by @davidzhao in https://github.com/livekit/agents/pull/2195
update transcriber example for agents 1.0 by @longcw in https://github.com/livekit/agents/pull/2198
cleanup examples + e2ee & stats examples by @theomonnom in https://github.com/livekit/agents/pull/2155
fix set rime tts instance attr url value. by @MaCaki in https://github.com/livekit/agents/pull/2202
fix Gemini Live function responses when using Vertex AI by @davidzhao in https://github.com/livekit/agents/pull/2194
Increases buffered words count to Cartesia's TTS service by @itsnicjohn in https://github.com/livekit/agents/pull/2206
11labs: fix default model and chunk_length_schedule by @davidzhao in https://github.com/livekit/agents/pull/2205
Add missing agents submodule docs, improve package readmes and docstrings by @bcherry in https://github.com/livekit/agents/pull/2184
fix llm.chat for plugins when using with empty tools by @jayeshp19 in https://github.com/livekit/agents/pull/2149
supress stream timeout errors in google stt by @jayeshp19 in https://github.com/livekit/agents/pull/2189
forward error from stt/tts stream adapter by @longcw in https://github.com/livekit/agents/pull/2215
add min_interruption_words by @longcw in https://github.com/livekit/agents/pull/2213
close room audio output when session close by @longcw in https://github.com/livekit/agents/pull/2211
Use assigned key and secret by @ChenghaoMou in https://github.com/livekit/agents/pull/2217
move drain_timeout to WorkerOptions, increase default to 30 mins by @davidzhao in https://github.com/livekit/agents/pull/2210
add MCP support by @theomonnom in https://github.com/livekit/agents/pull/2200
Add log when closing agent session from error by @Shubhrakanti in https://github.com/livekit/agents/pull/2218
share _to_deepgram_url to parse booleans correctly by @MartinGotelli in https://github.com/livekit/agents/pull/2225

New Contributors

@MaCaki made their first contribution in https://github.com/livekit/agents/pull/2202
@itsnicjohn made their first contribution in https://github.com/livekit/agents/pull/2206

Full Changelog: https://github.com/livekit/agents/compare/livekit-agent@1.0.19...livekit-agent@1.0.20

What's Changed

fix(google-tts): Audio encoding for Chirp3 voices not compatible with PCM encoding by @danishshaik in https://github.com/livekit/agents/pull/2176
Add ElevenLabs plugin support for SSML break tags by @tristan-warner-smith in https://github.com/livekit/agents/pull/2173
Added ability to set custom Rime URL by @milo157 in https://github.com/livekit/agents/pull/2158
Fix generate_reply for Gemini LLM by @davidzhao in https://github.com/livekit/agents/pull/2183
fix None default on function calls by @theomonnom in https://github.com/livekit/agents/pull/2187
google stt: allow configurable confidence score by @jayeshp19 in https://github.com/livekit/agents/pull/2178
Fix: FunctionOutputResponse not getting recognised to gemini live-api by @shashwatsanket997 in https://github.com/livekit/agents/pull/2185
ElevenLabs Scribe support #1655 by @nishadmusthafa in https://github.com/livekit/agents/pull/2161
Zg/hume plugin tweaks by @zgreathouse in https://github.com/livekit/agents/pull/2162

New Contributors

@tristan-warner-smith made their first contribution in https://github.com/livekit/agents/pull/2173
@milo157 made their first contribution in https://github.com/livekit/agents/pull/2158
@shashwatsanket997 made their first contribution in https://github.com/livekit/agents/pull/2185
@nishadmusthafa made their first contribution in https://github.com/livekit/agents/pull/2161
@zgreathouse made their first contribution in https://github.com/livekit/agents/pull/2162

Full Changelog: https://github.com/livekit/agents/compare/livekit-agent@1.0.18...livekit-agent@1.0.19

What's Changed

fix type hints for python 3.9 by @longcw in https://github.com/livekit/agents/pull/2118
fix conversion of chat context to dict by @jmugicagonz in https://github.com/livekit/agents/pull/2128
generate main response after fast llm done by @longcw in https://github.com/livekit/agents/pull/2119
fix(plugins-google): Fix Google TTS update options parameter names by @danishshaik in https://github.com/livekit/agents/pull/2124
Set Hume SDK version to 0.8.3 or greater by @bcherry in https://github.com/livekit/agents/pull/2121
Use PCM instead of OGG_OPUS for Google TTS by @chrisackermann in https://github.com/livekit/agents/pull/2139
Bug fix: Ensure mock room name is string in console mode by @MajorTal in https://github.com/livekit/agents/pull/2145
Improve decoding speed for wav by @davidzhao in https://github.com/livekit/agents/pull/2141
support session resumption and language in gemini live by @jayeshp19 in https://github.com/livekit/agents/pull/2129
support video input from screenshare by @longcw in https://github.com/livekit/agents/pull/2127
fix realtime response later than timeout by @longcw in https://github.com/livekit/agents/pull/2125
flush stt and wait for final transcription when commit_user_turn by @longcw in https://github.com/livekit/agents/pull/2147
Add mip_opt_out option for Deepgram TTS by @MartinGotelli in https://github.com/livekit/agents/pull/2159
Fix hume plugin defaults by @bcherry in https://github.com/livekit/agents/pull/2122
start room io before connect by @longcw in https://github.com/livekit/agents/pull/2167
fix retrieval example by @longcw in https://github.com/livekit/agents/pull/2172
avoid room io overwriting user defined io by @longcw in https://github.com/livekit/agents/pull/2170

New Contributors

@danishshaik made their first contribution in https://github.com/livekit/agents/pull/2124
@MartinGotelli made their first contribution in https://github.com/livekit/agents/pull/2159

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.0.17...livekit-agent@1.0.18

What's Changed

add bithuman deps for the plugin by @longcw in https://github.com/livekit/agents/pull/2090
fix: prevent duplicate metrics when switching between agents by @mateuszkulpa in https://github.com/livekit/agents/pull/2097
fix using raw tools with ChatContext copies by @zwily in https://github.com/livekit/agents/pull/2096
Simpler api to end the session and handling sip users by @Shubhrakanti in https://github.com/livekit/agents/pull/1950
improvements to Gemini Live handling by @davidzhao in https://github.com/livekit/agents/pull/2089
check participant kinds in room io by @longcw in https://github.com/livekit/agents/pull/2100
fix interruption context when the speech hasn't started yet by @theomonnom in https://github.com/livekit/agents/pull/2095
add the chat_ctx to the tracing page by @theomonnom in https://github.com/livekit/agents/pull/2103
fix debug tracing for proc executor by @longcw in https://github.com/livekit/agents/pull/2104
Add Hume TTS Plugin by @Saatvik07 in https://github.com/livekit/agents/pull/2063
Added timestamp to ChatMessage so it gets added to session history by @samudranb in https://github.com/livekit/agents/pull/1882
tavus avatar plugin by @longcw in https://github.com/livekit/agents/pull/2052
don't cancel user code on user_turn_completed by @theomonnom in https://github.com/livekit/agents/pull/2106
add chat_ctx timestamp utils by @theomonnom in https://github.com/livekit/agents/pull/2107
ensure correct message ordering when injecting speeches in on_user_turn_completed by @theomonnom in https://github.com/livekit/agents/pull/2108
expose the generated chat message inside the SpeechHandle by @theomonnom in https://github.com/livekit/agents/pull/2111
add an injected silence filler short response example by @theomonnom in https://github.com/livekit/agents/pull/2110
add VideoSampler to AgentSession by @theomonnom in https://github.com/livekit/agents/pull/2113
better Gemini video defaults by @theomonnom in https://github.com/livekit/agents/pull/2115

New plugins

livekit-plugins-hume — https://www.hume.ai/text-to-speech
livekit-plugins-tavus — https://docs.tavus.io/sections/conversational-video-interface/livekit-agent

New Contributors

@zwily made their first contribution in https://github.com/livekit/agents/pull/2096
@Saatvik07 made their first contribution in https://github.com/livekit/agents/pull/2063
@samudranb made their first contribution in https://github.com/livekit/agents/pull/1882

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.0.14...livekit-agents@1.0.17

What's Changed

azure speech sdk version upgrade (>=1.41.0 to >=1.43.0) by @jayeshp19 in https://github.com/livekit/agents/pull/2008
fix: resolve type mismatch between _TurnDetector protocol and plugins by @kechako in https://github.com/livekit/agents/pull/2002
feat: enhance openai LLM metrics to include cached prompt tokens by @theomonnom in https://github.com/livekit/agents/pull/2013
delete livekit-plugins-rag by @theomonnom in https://github.com/livekit/agents/pull/1995
fix: add missing FunctionToolsExecutedEvent export by @mateuszkulpa in https://github.com/livekit/agents/pull/2016
detect leaked tasks on tests by @theomonnom in https://github.com/livekit/agents/pull/1993
toxic proxy & bring back tts tests by @theomonnom in https://github.com/livekit/agents/pull/1982
fix 11labs timeout & tests by @theomonnom in https://github.com/livekit/agents/pull/2017
Emit errors from open ai realtime model by @Shubhrakanti in https://github.com/livekit/agents/pull/1968
fix prompt_cached_tokens in llm metrics by @longcw in https://github.com/livekit/agents/pull/2024
simplify google tts voice params by @jayeshp19 in https://github.com/livekit/agents/pull/2025
fix gemini live interruption by @jayeshp19 in https://github.com/livekit/agents/pull/2029
support with_azure method in openai stt/tts by @jayeshp19 in https://github.com/livekit/agents/pull/2030
add bey avatar plugin by @longcw in https://github.com/livekit/agents/pull/2031
avoid duplicate room io initialization by @longcw in https://github.com/livekit/agents/pull/2037
add wait_for_participant as a function by @longcw in https://github.com/livekit/agents/pull/2039
fix realtime default turn detection and transcription for azure openai by @jayeshp19 in https://github.com/livekit/agents/pull/2041
allow overriding eou threshold by @jeradf in https://github.com/livekit/agents/pull/2035
Speechify TTS Plugin by @chaerla in https://github.com/livekit/agents/pull/2044
Readme updates by @davidzhao in https://github.com/livekit/agents/pull/2045
Fix dangling websocket connections by @ChenghaoMou in https://github.com/livekit/agents/pull/2027
move wait_for_participant to utils by @longcw in https://github.com/livekit/agents/pull/2047
add recovery method for OAI realtime text response by @longcw in https://github.com/livekit/agents/pull/2015
fix Speechify tests by @theomonnom in https://github.com/livekit/agents/pull/2051
fix openai timeout & tests by @theomonnom in https://github.com/livekit/agents/pull/2020
Speechify TTS Plugin Improvements by @chaerla in https://github.com/livekit/agents/pull/2056
support raw function descriptions by @theomonnom in https://github.com/livekit/agents/pull/2055
add bithuman avatar plugin by @longcw in https://github.com/livekit/agents/pull/2054
Misc fixes by @davidzhao in https://github.com/livekit/agents/pull/2049
fix discarded jobs when launching processes by @theomonnom in https://github.com/livekit/agents/pull/2059
fix generate_reply instructions by @theomonnom in https://github.com/livekit/agents/pull/2058
keep exception chaining by @theomonnom in https://github.com/livekit/agents/pull/1990
Use ogg by default for speechify by @davidzhao in https://github.com/livekit/agents/pull/2068
fix(gemini live): avoid duplicating input by @davidzhao in https://github.com/livekit/agents/pull/2069
fix realtime interruption for VAD turn detection by @longcw in https://github.com/livekit/agents/pull/2072
reset stt when clear user turn by @longcw in https://github.com/livekit/agents/pull/2070
Bug Fix - wrong transition to SPEAKING when the agent is in fact listening by @MajorTal in https://github.com/livekit/agents/pull/2075
support default arguments on function tools by @theomonnom in https://github.com/livekit/agents/pull/2076
store audio-synchronized transcript in chat_ctx when interrupted by @theomonnom in https://github.com/livekit/agents/pull/2071
support RunContext on raw function tools by @theomonnom in https://github.com/livekit/agents/pull/2077
Bug fix in agent_activity.py: user_state events were not fired by @MajorTal in https://github.com/livekit/agents/pull/2078
Support gemini thinking budget. by @pmaldonado in https://github.com/livekit/agents/pull/2060
publish legacy transcription event for avatar by @longcw in https://github.com/livekit/agents/pull/2074
merge anyOf optional unions to type list by @theomonnom in https://github.com/livekit/agents/pull/2079
fix optional arguments on function tools by @theomonnom in https://github.com/livekit/agents/pull/2080

New plugins

livekit-plugins-speechify — https://speechify.com/text-to-speech-api/
livekit-plugins-bithuman — https://bithuman.mintlify.app/api-reference/sdk/quick-start#1-livekit-agent
livekit-plugins-bey — https://docs.bey.dev/integration/livekit

New Contributors

@kechako made their first contribution in https://github.com/livekit/agents/pull/2002
@mateuszkulpa made their first contribution in https://github.com/livekit/agents/pull/2016
@chaerla made their first contribution in https://github.com/livekit/agents/pull/2044
@pmaldonado made their first contribution in https://github.com/livekit/agents/pull/2060

Full Changelog: https://github.com/livekit/agents/compare/livekit-agents@1.0.13...livekit-agents@1.0.14

Agents (Python)

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

Patch Changes

What's Changed

New Contributors

What's Changed

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New Contributors

What's Changed

New plugins

New Contributors

What's Changed

New plugins

New Contributors

More from this team

Similar releases

Other sources from this team

Similar sources

More from this team

Similar releases

Similar sources

Other sources from this team