v4.40.1: fix `EosTokenCriteria` for `Llama3` on `mps`
Kudos to @pcuenca for the prompt fix in:
To support EosTokenCriteria on MPS while pytorch adds this functionality.
EosTokenCriteria
pytorch
Fetched April 7, 2026