Notable changes:

• More GPTQ support
• Rope scaling (linear + dynamic)
• Bitsandbytes 4bits (both modes)
• Added more documentation

What's Changed

• Local gptq support. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/738
• Fix typing in Model.generate_token by @jaywonchung in https://github.com/huggingface/text-generation-inference/pull/733
• Adding Rope scaling. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/741
• chore: fix typo in mpt_modeling.py by @eltociear in https://github.com/huggingface/text-generation-inference/pull/737
• fix(server): Failing quantize config after local read. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/743
• Typo fix. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/746
• fix typo for dynamic rotary by @flozi00 in https://github.com/huggingface/text-generation-inference/pull/745
• add FastLinear import by @zspo in https://github.com/huggingface/text-generation-inference/pull/750
• Automatically map deduplicated safetensors weights to their original values (#501) by @Narsil in https://github.com/huggingface/text-generation-inference/pull/761
• feat(server): Add native support for PEFT Lora models by @Narsil in https://github.com/huggingface/text-generation-inference/pull/762
• This should prevent the PyTorch overriding. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/767
• fix build tokenizer in quantize and remove duplicate import by @zspo in https://github.com/huggingface/text-generation-inference/pull/768
• Merge BNB 4bit. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/770
• Fix dynamic rope. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/783
• Fixing non 4bits quantization. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/785
• Update init.py by @Narsil in https://github.com/huggingface/text-generation-inference/pull/794
• Llama change. by @Narsil in https://github.com/huggingface/text-generation-inference/pull/793
• Setup for doc-builder and docs for TGI by @merveenoyan in https://github.com/huggingface/text-generation-inference/pull/740
• Use destructuring in router arguments to avoid '.0' by @ivarflakstad in https://github.com/huggingface/text-generation-inference/pull/798
• Fix gated docs by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/805
• Minor docs style fixes by @osanseviero in https://github.com/huggingface/text-generation-inference/pull/806
• Added CLI docs and rename docker launch by @merveenoyan in https://github.com/huggingface/text-generation-inference/pull/799
• [docs] Build docs only when doc files change by @mishig25 in https://github.com/huggingface/text-generation-inference/pull/812
• Added ChatUI Screenshot to Docs by @merveenoyan in https://github.com/huggingface/text-generation-inference/pull/823
• Upgrade transformers (fix protobuf==3.20 issue) by @Narsil in https://github.com/huggingface/text-generation-inference/pull/795
• Added streaming for InferenceClient by @merveenoyan in https://github.com/huggingface/text-generation-inference/pull/821
• Version 1.0.1 by @Narsil in https://github.com/huggingface/text-generation-inference/pull/836

New Contributors

• @jaywonchung made their first contribution in https://github.com/huggingface/text-generation-inference/pull/733
• @eltociear made their first contribution in https://github.com/huggingface/text-generation-inference/pull/737
• @flozi00 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/745
• @zspo made their first contribution in https://github.com/huggingface/text-generation-inference/pull/750
• @ivarflakstad made their first contribution in https://github.com/huggingface/text-generation-inference/pull/798
• @osanseviero made their first contribution in https://github.com/huggingface/text-generation-inference/pull/805
• @mishig25 made their first contribution in https://github.com/huggingface/text-generation-inference/pull/812

Full Changelog: https://github.com/huggingface/text-generation-inference/compare/v1.0.0...v1.0.1