releases.shpreview
Hugging Face/Tokenizers/python-v0.10.3

python-v0.10.3

Python v0.10.3

May 24, 2021TokenizersView original ↗
$npx -y @buildinternet/releases show rel_YZWsZRSomX2iQLPyBVOfy

Fixed

  • [#686]: Fix SPM conversion process for whitespace deduplication
  • [#707]: Fix stripping strings containing Unicode characters

Added

  • [#693]: Add a CTC Decoder for Wave2Vec models

Removed

  • [#714]: Removed support for Python 3.5

Fetched April 7, 2026

python-v0.10.3 — Tokenizers — releases.sh