v1.1.1

What's Changed

• Fix launcher.md by @mishig25 in https://github.com/huggingface/text-generation-inference/pull/1075
• Update launcher.md to wrap code blocks by @mishig25 in https://github.com/huggingface/text-generation-inference/pull/1076
• Fixing eetq dockerfile. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1081
• Fix window_size_left for flash attention v1 by @peterlowrance in https://github.com/huggingface/text-generation-inference/pull/1089
• raise exception on invalid images by @leot13 in https://github.com/huggingface/text-generation-inference/pull/999
• [Doc page] Fix launcher page highlighting by @mishig25 in https://github.com/huggingface/text-generation-inference/pull/1080
• Handling bloom prefix. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1090
• Update idefics_image_processing.py by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1091
• fixed command line arguments in docs by @Fluder-Paradyne in https://github.com/huggingface/text-generation-inference/pull/1092
• Adding titles to CLI doc. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1094
• Receive base64 encoded images for idefics. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1096
• Modify the default for max_new_tokens. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1097
• fix: type hint typo in tokens.py by @vejvarm in https://github.com/huggingface/text-generation-inference/pull/1102
• Fixing GPTQ exllama kernel usage. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1101
• Adding yarn support. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1099
• Hotfixing idefics base64 parsing. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1103
• Prepare for v1.1.1 by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1100
• Remove some content from the README in favour of the documentation by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/958
• Fix link in preparing_model.md by @mishig25 in https://github.com/huggingface/text-generation-inference/pull/1140
• Fix calling cuda() on load_in_8bit by @mmngays in https://github.com/huggingface/text-generation-inference/pull/1153
• Fix: Replace view() with reshape() in neox_modeling.py to resolve RuntimeError by @Mario928 in https://github.com/huggingface/text-generation-inference/pull/1155
• fix: EETQLinear with bias in layers.py by @SidaZh in https://github.com/huggingface/text-generation-inference/pull/1176
• fix: remove useless token by @rtrompier in https://github.com/huggingface/text-generation-inference/pull/1179
• #1049 CI by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1178
• Fix link to quantization page in preparing_model.md by @aasthavar in https://github.com/huggingface/text-generation-inference/pull/1187
• feat: paged attention v2 by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1183
• feat: remove flume by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1184
• Adding the video -> moving the architecture picture lower by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1239
• Narsil patch 1 by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1241
• Update README.md by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1242
• Fix link in quantization guide by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/1246

New Contributors

• @peterlowrance made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1089
• @leot13 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/999
• @Fluder-Paradyne made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1092
• @vejvarm made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1102
• @mmngays made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1153
• @Mario928 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1155
• @SidaZh made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1176
• @rtrompier made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1179
• @aasthavar made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1187

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.1.0...v1.1.1