releases.shpreview

Assisted decoding fixed for EncoderDecoderCache models; SDPA prefill hardened

v5.14.1

4 fixesThis release4 fixesBug fixesAI-tallied from the release notes
From the original release noteView original ↗

Patch release v5.14.1

This patch solves a few issues which appeared when integrating Inkling model, most notably an issue affecting models using EncoderDecoderCache during assisted generation. It also fixes an issue that could appear during prefill with StaticCache and sdpa without padding for Inkling which uses a position_bias. It contains the following commits:

Fetched July 16, 2026