Prompt caching cuts token costs 50%; no code changes needed

Prompt caching automatically reuses computation from recent requests sharing a common prefix, delivering cost savings and improved response times with volatile-only storage that expires automatically.

How It Works: prefix matching against recently processed requests; cache hit reuses computation reducing latency and cutting token costs by 50% for cached portions; cache miss processes normally and caches the prefix; automatic expiration within a few hours.

Rolling out first to Kimi K2, with more models coming. No code changes or additional fees required.