Text Embeddings Inference

What's Changed

• Use rust-toolchain.toml before rustup on Dockerfile-{cuda,cuda-all} by @alvarobartt in https://github.com/huggingface/text-...

What's Changed

• Fix auto-truncate false setting by @vrdn-23 in https://github.com/huggingface/text-embeddings-inference/pull/836
• Set `pad_to...

What's Changed

🚨 Fix

• Fix support for containers w/ CUDA 13.0+ by @alvarobartt in https://github.com/huggingface/text-embeddings-infere...

<img width="1800" height="972" alt="text-embeddings-inference-v1 9 0" src="https://github.com/user-attachments/assets/fe3751d1-1a3a-4b1f-8cf5-5c2326c1...

What's Changed

Bug Fixes

• Fix error code for empty requests by @vrdn-23 in https://github.com/huggingface/text-embeddings-inference/pull...

🔧 Fixed Intel MKL Support

Since Text Embeddings Inference (TEI) v1.7.0, Intel MKL support had been broken due to changes in the candle depend...

<img width="1200" height="648" alt="text-embeddings-inference-v1 8 1-embedding-gemma(1)" src="https://github.com/user-attachments/assets/8ad8fb64-cee4...

<img width="3600" height="1944" alt="text-embeddings-inference-v1 8 0(2)" src="https://github.com/user-attachments/assets/50df05b6-3821-4e2a-8de0-3e5c...

Noticeable Changes

Qwen3 was not working fine on CPU / MPS when sending batched requests on FP16 precision, due to the FP32 minimum value downca...

Noticeable Changes

Qwen3 support included for Intel HPU, and fixed for CPU / Metal / CUDA.

What's Changed

• Default to Qwen3 in `README...

Notable change

• Added support for Qwen3 embeddigns

What's Changed

• Adding suggestions to fixing missing ONNX files. by @Narsil in https...

What's Changed

• [Docs] Update quick tour by @NielsRogge in https://github.com/huggingface/text-embeddings-inference/pull/574
• Update `README.md...

Notable changes

• Upgrade dependencies heavily (candle 0.5 -> 0.8 and related)
• Added ModernBert support by @kozistr !

What's Changed

...

What's Changed

• Enable intel devices CPU/XPU/HPU for python backend by @yuanwu2017 in https://github.com/huggingface/text-embeddings-inference/pu...

What's Changed

• feat: support multiple backends at the same time by @OlivierDehaene in https://github.com/huggingface/text-embeddings-inference/p...

What's Changed

• Download model.onnx_data by @kozistr in https://github.com/huggingface/text-embeddings-inference/pull/343
• Rename 'Sentence T...

Notable Changes

• ONNX runtime for CPU deployments: greatly improve CPU deployment throughput
• Add /similarity route

What's Changed

*...

Notable Changes

• Cuda support for the Qwen2 model architecture

What's Changed

• feat(candle): support Qwen2 on Cuda by @OlivierDehaene i...

Notable changes

• New truncation direction parameter
• Cuda support for JinaCode ...

What's Changed

• fix limit peak memory to build cuda-all docker image by @OlivierDehaene in https://github.com/huggingface/text-embeddings-infer...