v2.0.3

Important changes

• Add: Support for the Falcon2 by @Nilabhra in https://github.com/huggingface/text-generation-inference/pull/1886
• New speculation method MLPSpeculator. by @JRosenkranz in https://github.com/huggingface/text-generation-inference/pull/1865
• Pali gemma modeling by @drbh in https://github.com/huggingface/text-generation-inference/pull/1895

What's Changed

• Fix: "Fixing" double BOS for mistral too. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1843
• Adding scripts to prepare load data. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1841
• Remove misleading warning (not that important nowadays anyway). by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1848
• feat: prefer huggingface_hub in docs and show image api by @drbh in https://github.com/huggingface/text-generation-inference/pull/1844
• Updating Phi3 (long context). by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1849
• Add router name to /info endpoint by @Wauplin in https://github.com/huggingface/text-generation-inference/pull/1854
• Upgrading to rust 1.78. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1851
• update xpu docker image and use public ipex whel by @sywangyi in https://github.com/huggingface/text-generation-inference/pull/1860
• Refactor layers. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1866
• Granite support? by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1882
• Add: Support for the Falcon2 11B architecture by @Nilabhra in https://github.com/huggingface/text-generation-inference/pull/1886
• MLPSpeculator. by @JRosenkranz in https://github.com/huggingface/text-generation-inference/pull/1865
• Fixing truncation. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1890
• Correct 'using guidance' link by @brandon-lockaby in https://github.com/huggingface/text-generation-inference/pull/1892
• Add GPT-2 with flash attention by @danieldk in https://github.com/huggingface/text-generation-inference/pull/1889
• Removing accepted ids in the regular info logs, downgrade to debug. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1898
• feat: add deprecation warning to clients by @drbh in https://github.com/huggingface/text-generation-inference/pull/1855
• [Bug Fix] Update torch import reference in bnb quantization by @DhruvSrikanth in https://github.com/huggingface/text-generation-inference/pull/1902
• Pali gemma modeling by @drbh in https://github.com/huggingface/text-generation-inference/pull/1895

New Contributors

• @Nilabhra made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1886
• @brandon-lockaby made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1892
• @danieldk made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1889
• @DhruvSrikanth made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1902

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v2.0.2...v2.0.3