v1.1.0

Notable changes

• Support for Mistral models (#1071)
• AWQ quantization (#1019)
• EETQ quantization (#1068)

What's Changed

• Fix f180 by @Narsil in https://github.com/huggingface/text-generation-inference/pull/951
• Fix Falcon weight mapping for H2O.ai checkpoints by @Vinno97 in https://github.com/huggingface/text-generation-inference/pull/953
• Fixing top_k tokens when k ends up < 0 by @Narsil in https://github.com/huggingface/text-generation-inference/pull/966
• small fix on idefics by @VictorSanh in https://github.com/huggingface/text-generation-inference/pull/954
• chore(client): Support Pydantic 2 by @JelleZijlstra in https://github.com/huggingface/text-generation-inference/pull/900
• docs: typo in streaming.js by @revolunet in https://github.com/huggingface/text-generation-inference/pull/971
• Disabling exllama on old compute. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/986
• sync text-generation version from 0.3.0 to 0.6.0 with pyproject.toml by @yzbx in https://github.com/huggingface/text-generation-inference/pull/950
• Fix exllama wronfully loading by @maximelaboisson in https://github.com/huggingface/text-generation-inference/pull/990
• add transformers gptq support by @flozi00 in https://github.com/huggingface/text-generation-inference/pull/963
• Fix call vs forward. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/993
• fit for baichuan models by @XiaoBin1992 in https://github.com/huggingface/text-generation-inference/pull/981
• Fix missing arguments in Galactica's from_pb by @Vinno97 in https://github.com/huggingface/text-generation-inference/pull/1022
• Fixing t5 loading. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1042
• Add AWQ quantization inference support (#1019) by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1054
• Fix GQA llama + AWQ by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1061
• support local model config file by @zhangsibo1129 in https://github.com/huggingface/text-generation-inference/pull/1058
• fix discard_names bug in safetensors convertion by @zhangsibo1129 in https://github.com/huggingface/text-generation-inference/pull/1052
• Install curl to be able to perform more advanced healthchecks by @oOraph in https://github.com/huggingface/text-generation-inference/pull/1033
• Fix position ids logic instantiation of idefics vision part by @VictorSanh in https://github.com/huggingface/text-generation-inference/pull/1064
• Fix top_n_tokens returning non-log probs for some models by @Vinno97 in https://github.com/huggingface/text-generation-inference/pull/1023
• Support eetq weight only quantization by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1068
• Remove the stripping of the prefix space (and any other mangling that tokenizers might do). by @Narsil in https://github.com/huggingface/text-generation-inference/pull/1065
• Complete FastLinear.load parameters in OPTDecoder initialization by @zhangsibo1129 in https://github.com/huggingface/text-generation-inference/pull/1060
• feat: add mistral model by @OlivierDehaene in https://github.com/huggingface/text-generation-inference/pull/1071

New Contributors

• @VictorSanh made their first contribution in https://github.com/huggingface/text-generation-inference/pull/954
• @JelleZijlstra made their first contribution in https://github.com/huggingface/text-generation-inference/pull/900
• @revolunet made their first contribution in https://github.com/huggingface/text-generation-inference/pull/971
• @yzbx made their first contribution in https://github.com/huggingface/text-generation-inference/pull/950
• @maximelaboisson made their first contribution in https://github.com/huggingface/text-generation-inference/pull/990
• @XiaoBin1992 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/981
• @sywangyi made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1034
• @zhangsibo1129 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/1058

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.0.3...v1.1.0