rust-v0.10.0

Changed

• [#222]: All Tokenizer's subparts must now be Send + Sync

Added

• [#208]: Ability to retrieve the vocabulary from the Tokenizer & Model

Fixed

• [#205]: Trim the decoded string in BPEDecoder
• [b770f36]: Fix a bug with added tokens generated IDs