releases.shpreview

Hugging Face/Text Generation Inference/v1.0.2

v1.0.2

August 23, 2023Text Generation InferenceView original ↗

$npx -y @buildinternet/releases show rel_H97mWUUHQXfXueb76VPcr

What's Changed

Have snippets in Python/JavaScript in quicktour by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/809
Added two more features in readme.md file by @sawanjr in https://github.com/huggingface/text-generation-inference/pull/831
Fix rope dynamic + factor by @Narsil in https://github.com/huggingface/text-generation-inference/pull/822
fix: LlamaTokenizerFast to AutoTokenizer at flash_llama.py by @dongs0104 in https://github.com/huggingface/text-generation-inference/pull/619
README edit -- running the service with no GPU or CUDA support by @pminervini in https://github.com/huggingface/text-generation-inference/pull/773
Fix tokenizers==0.13.4 . by @Narsil in https://github.com/huggingface/text-generation-inference/pull/838
Update README.md by @adarshxs in https://github.com/huggingface/text-generation-inference/pull/848
Fixing watermark. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/851
Misc minor improvements for InferenceClient docs by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/852
"Fix" for rw-1b. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/860
Upgrading versions of python client. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/862
Adding Idefics multi modal model. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/842
Add streaming guide by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/858
Adding small benchmark script. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/881

New Contributors

@sawanjr made their first contribution in https://github.com/huggingface/text-generation-inference/pull/831
@dongs0104 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/619
@pminervini made their first contribution in https://github.com/huggingface/text-generation-inference/pull/773
@adarshxs made their first contribution in https://github.com/huggingface/text-generation-inference/pull/848

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.0.1...v1.0.2

Fetched April 7, 2026