releases.shpreview
Hugging Face/Tokenizers/python-v0.4.1

python-v0.4.1

Python v0.4.1

February 11, 2020TokenizersView original ↗
$npx -y @buildinternet/releases show rel_dQPwyUm4GlMTlMPKK4TlF

Fixes:

  • Fix a bug related to the punctuation in BertWordPieceTokenizer (Thanks to @Mansterteddy with #134)

Fetched April 7, 2026