releases.sh
preview
Search
Docs
Hugging Face
/
Tokenizers
/
python-v0.5.2
python-v0.5.2
Python v0.5.2
February 24, 2020
Tokenizers
View original ↗
$
npx -y @buildinternet/releases show rel_K7gCjp4JlPNz2AmubqFWq
Fixes:
We introduced a bug related to the saving of the WordPiece model in 0.5.2: The
vocab.txt
file was named
vocab.json
. This is now fixed.
The
WordLevel
model was also saving its vocabulary in the wrong format.
Fetched April 7, 2026