releases.shpreview
Hugging Face/Tokenizers/python-v0.10.2

python-v0.10.2

Python v0.10.2

April 5, 2021TokenizersView original ↗
$npx -y @buildinternet/releases show rel_zaXwDSWkvrnNZ8uZnWvrC

Fixed

  • [#652]: Fix offsets for Precompiled corner case
  • [#656]: Fix BPE continuing_subword_prefix
  • [#674]: Fix Metaspace serialization problems

Fetched April 7, 2026