releases.shpreview
Hugging Face/Tokenizers/python-v0.11.6

python-v0.11.6

Python v0.11.6

February 28, 2022TokenizersView original ↗
$npx -y @buildinternet/releases show rel_08xH1diKitsTTUX6ErUUZ
  • [#919] Fixing single_word AddedToken. (regression from 0.11.2)
  • [#916] Deserializing faster added_tokens by loading them in batch.

Fetched April 7, 2026

python-v0.11.6 — Tokenizers — releases.sh