releases.shpreview
Hugging Face/Tokenizers/python-v0.5.2

python-v0.5.2

Python v0.5.2

$npx -y @buildinternet/releases show rel_K7gCjp4JlPNz2AmubqFWq

Fixes:

  • We introduced a bug related to the saving of the WordPiece model in 0.5.2: The vocab.txt file was named vocab.json. This is now fixed.
  • The WordLevel model was also saving its vocabulary in the wrong format.

Fetched April 7, 2026