releases.shpreview

Hugging Face/Tokenizers/python-v0.2.1

python-v0.2.1

Python v0.2.1

January 22, 2020TokenizersView original ↗

$npx -y @buildinternet/releases show rel_qgdTEVO0pywsB9f8VACjY

Fix a bug with the IDs associated with added tokens.
Fix a bug that was causing crashes in Python 3.5

Fetched April 7, 2026