--- name: Inference slug: inference organization_slug: hugging-face category: ai source_count: 2 canonical: https://releases.sh/hugging-face/inference --- # Inference Optimized inference servers for text and embeddings ## Sources (2) - [Text Embeddings Inference](https://releases.sh/hugging-face/text-embeddings-inference) — `github` - [Text Generation Inference](https://releases.sh/hugging-face/text-generation-inference) — `github` ## Recent Releases _Summaries below — fetch the release's `canonical` URL for full content, or `url` for the original source._ ## What's Changed * Use `rust-toolchain.toml` before `rustup` on `Dockerfile-{cuda,cuda-all}` by @alvarobartt in https://github.com/huggingface/text-... ## What's Changed * Fix auto-truncate false setting by @vrdn-23 in https://github.com/huggingface/text-embeddings-inference/pull/836 * Set `pad_to... ## What's Changed ### 🚨 Fix * Fix support for containers w/ CUDA 13.0+ by @alvarobartt in https://github.com/huggingface/text-embeddings-infere... text-embeddings-inference-v1 9 0 ## What's Changed * misc(gha): expose action cache url and runtime as secrets by @mfuntowicz in https://github.com/huggingface/text-generation-infere... ## What's Changed ### Bug Fixes * Fix error code for empty requests by @vrdn-23 in https://github.com/huggingface/text-embeddings-inference/pull... ## What's Changed * Add missing backslash by @philsupertramp in https://github.com/huggingface/text-generation-inference/pull/3311 * Revert "feat: b... ## 🔧 Fixed Intel MKL Support Since Text Embeddings Inference (TEI) v1.7.0, Intel MKL support had been broken due to changes in the `candle` depend... text-embeddings-inference-v1 8 1-embedding-gemma(1) ## What's Changed * [gaudi] Refine rope memory, do not need to keep sin/cos cache per layer by @sywangyi in https://github.com/huggingface/text-gener... **Tags:** `inference`, `rust`, `serving`