v5.0.0rc3 — Transformers

New models:

[GLM-4.7] GLM-Lite Supoort by @zRzRzRzRzRzRzR in https://github.com/huggingface/transformers/pull/43031
[GLM-Image] AR Model Support for GLM-Image by @zRzRzRzRzRzRzR in https://github.com/huggingface/transformers/pull/43100
Add LWDetr model by @sbucaille in https://github.com/huggingface/transformers/pull/40991
Add LightOnOCR model implementation by @baptiste-aubertin in https://github.com/huggingface/transformers/pull/41621

What's Changed

We are getting closer and closer to the official release! This RC is focused on removing more of the deprecated stuff, fixing some minors issues, doc updates.

Update Japanese README to match English version by @lilin-1 in https://github.com/huggingface/transformers/pull/43069
[docs] Deploying by @stevhliu in https://github.com/huggingface/transformers/pull/42263
[docs] inference engines by @stevhliu in https://github.com/huggingface/transformers/pull/42932
Fix typos: Remove duplicate duplicate words words by @efeecllk in https://github.com/huggingface/transformers/pull/43040
[style] Rework ruff rules and update all files by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43144
[CB] Minor fix in kwargs by @remi-or in https://github.com/huggingface/transformers/pull/43147
[Bug] qwen2_5_omni: cap generation length to be less than the max_position_embedding in DiT by @sniper35 in https://github.com/huggingface/transformers/pull/43068
Fix some deprecated practices in torch 2.9 by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43167
Fix Fuyu processor width dimension bug in _get_num_multimodal_tokens by @Abhinavexists in https://github.com/huggingface/transformers/pull/43137
Inherit from PreTrainedTokenizerBase by @juliendenize in https://github.com/huggingface/transformers/pull/43143
Generation config boolean defaults by @zucchini-nlp in https://github.com/huggingface/transformers/pull/43000
Fix failing BartModelIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43160
fix failure of llava/pixtral by @sywangyi in https://github.com/huggingface/transformers/pull/42985
GemmaTokenizer: remove redundant whitespace pre-tokenizer by @vaibhav-research in https://github.com/huggingface/transformers/pull/43106
Support auto_doctring in Processors by @yonigozlan in https://github.com/huggingface/transformers/pull/42101
Fix failing BitModelIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43164
[Fp8] Fix experts by @vasqu in https://github.com/huggingface/transformers/pull/43154
Docs: improve wording for documentation build instructions by @Sailnagale in https://github.com/huggingface/transformers/pull/43007
[makefile] Cleanup and improve the rules by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43171
Some new models added stuff that was already removed by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43179
Fixes and compilation warning in torchao docs by @merveenoyan in https://github.com/huggingface/transformers/pull/42909
[cache] Remove all deprecated classes by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43168
Bump huggingface_hub minimal version by @Wauplin in https://github.com/huggingface/transformers/pull/43188
Rework check_config_attributes.py by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43191
Fix generation config validation by @zucchini-nlp in https://github.com/huggingface/transformers/pull/43175
[style] Use 'x | y' syntax for processors as well by @Wauplin in https://github.com/huggingface/transformers/pull/43189
Remove deprecated objects by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43170
fix chunked prefill implementation issue-43082 by @marcndo in https://github.com/huggingface/transformers/pull/43132
Reduce add_dates verbosity by @yonigozlan in https://github.com/huggingface/transformers/pull/43184
Add support for MiniMax-M2 by @rogeryoungh in https://github.com/huggingface/transformers/pull/42028
Fix failing salesforce-ctrl, xlm & gpt-neo model generation tests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43180
Less verbose library helpers by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43197
run all test files on CircleCI by @ydshieh in https://github.com/huggingface/transformers/pull/43146
Clamp temperature to >=1.0 for Dia generation by @Haseebasif7 in https://github.com/huggingface/transformers/pull/43029
Fix spelling typos in comments and code by @raimbekovm in https://github.com/huggingface/transformers/pull/43046
[docs] llama.cpp by @stevhliu in https://github.com/huggingface/transformers/pull/43185
[docs] gptq formatting fix by @victorywwong in https://github.com/huggingface/transformers/pull/43216
Grouped beam search from config params by @zucchini-nlp in https://github.com/huggingface/transformers/pull/42472
[Generate] Allow custom config values in generate config by @vasqu in https://github.com/huggingface/transformers/pull/43181
Fix failing Pix2StructIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43229
Fix missing UTF-8 encoding in check_repo.py for Windows compatibility by @aarushisingh04 in https://github.com/huggingface/transformers/pull/43123
[Tokenizer] Change default value of return_dict to True in doc string for apply_chat_template by @kashif in https://github.com/huggingface/transformers/pull/43223
Fix failing PhiIntegrationTests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43214
Use HF_TOKEN directly and remove require_read_token by @ydshieh in https://github.com/huggingface/transformers/pull/43233
Fix failing Owlv2ModelIntegrationTest & OwlViTModelIntegrationTest by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43182
Fix flashattn wrt quantized models by @SunMarc in https://github.com/huggingface/transformers/pull/43145
Remove unused imports by @cyyever in https://github.com/huggingface/transformers/pull/43078
Fix unsafe torch.load() in _load_rng_state allowing arbitrary code execution by @ColeMurray in https://github.com/huggingface/transformers/pull/43140
Reapply modular to examples by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43234
More robust diff checks in add_dates by @yonigozlan in https://github.com/huggingface/transformers/pull/43199
docs: fix grammatical error in README.md by @davidfertube in https://github.com/huggingface/transformers/pull/43236
Fix typo: seperately → separately in lw_detr converter by @skyvanguard in https://github.com/huggingface/transformers/pull/43235
Qwen-VL video processor accepts min/max pixels by @zucchini-nlp in https://github.com/huggingface/transformers/pull/43228
Deprecate dtype per sub config by @zucchini-nlp in https://github.com/huggingface/transformers/pull/42990
Remove more deprecated objects/args by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43195
[CB] Soft-reset offloading by @remi-or in https://github.com/huggingface/transformers/pull/43150
Make benchmark-v2 to be device agnostic, to support more torch built-in devices like xpu by @yao-matrix in https://github.com/huggingface/transformers/pull/43153
Fix benchmark script by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43253
Adding to run slow by @IlyasMoutawwakil in https://github.com/huggingface/transformers/pull/43250
Fix failing Vip-llava model integration test by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43252
Remove deprecated and unused position_ids in all apply_rotary_pos_emb by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43255
fix _get_test_info in testing_utils.py by @ydshieh in https://github.com/huggingface/transformers/pull/43259
Fix failing Hiera, SwiftFormer & LED Model integration tests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43225
[style] Fix init isort and align makefile and CI by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43260
[docs] tensorrt-llm by @stevhliu in https://github.com/huggingface/transformers/pull/43176
[consistency] Ensure models are added to the _toctree.yml by @Cyrilvallez in https://github.com/huggingface/transformers/pull/43264
Fix failing PegasusX, Mvp & LED model integration tests by @Sai-Suraj-27 in https://github.com/huggingface/transformers/pull/43245
[CB] Ensure parallel decoding test passes using FA by @remi-or in https://github.com/huggingface/transformers/pull/43277
fix crash in when running FSDP2+TP by @sywangyi in https://github.com/huggingface/transformers/pull/43226
[ci] Fixing some failing tests for important models by @Abdennacer-Badaoui in https://github.com/huggingface/transformers/pull/43231

New Contributors

@efeecllk made their first contribution in https://github.com/huggingface/transformers/pull/43040
@sniper35 made their first contribution in https://github.com/huggingface/transformers/pull/43068
@Abhinavexists made their first contribution in https://github.com/huggingface/transformers/pull/43137
@vaibhav-research made their first contribution in https://github.com/huggingface/transformers/pull/43106
@Sailnagale made their first contribution in https://github.com/huggingface/transformers/pull/43007
@rogeryoungh made their first contribution in https://github.com/huggingface/transformers/pull/42028
@Haseebasif7 made their first contribution in https://github.com/huggingface/transformers/pull/43029
@victorywwong made their first contribution in https://github.com/huggingface/transformers/pull/43216
@aarushisingh04 made their first contribution in https://github.com/huggingface/transformers/pull/43123
@ColeMurray made their first contribution in https://github.com/huggingface/transformers/pull/43140
@davidfertube made their first contribution in https://github.com/huggingface/transformers/pull/43236
@skyvanguard made their first contribution in https://github.com/huggingface/transformers/pull/43235
@baptiste-aubertin made their first contribution in https://github.com/huggingface/transformers/pull/41621

Full Changelog: https://github.com/huggingface/transformers/compare/v5.0.0rc2...v5.0.0rc3