Clone
Tokenizer
Encoding.into_tokens()
Full Changelog: https://github.com/huggingface/tokenizers/compare/v0.15.0...v0.15.1
Fetched April 7, 2026