v0.23.1

What's Changed

• ♨️ [GRPO] Fix potential hang in get_high_entropy_mask by @akakakakakaa in https://github.com/huggingface/trl/pull/4041
• Aux loss is already included in the loss returned by Transformers by @pramodith in https://github.com/huggingface/trl/pull/4078
• Fix get_peft_model() so that prepare_model_for_kbit_training does not reapply to an instance of PeftModel, thus freezing all the layers by @Hoesu in https://github.com/huggingface/trl/pull/4081
• 🐯 fix: use_liger_kernel with IterableDataset by @jue-jue-zi in https://github.com/huggingface/trl/pull/4087
• [SFTrainer]: Fix DFT Loss by @pramodith in https://github.com/huggingface/trl/pull/4112
• ⚡ Fix Flash Attention x Padding-Free loss by @qgallouedec in https://github.com/huggingface/trl/pull/4170

New Contributors

• @Hoesu made their first contribution in https://github.com/huggingface/trl/pull/4081

Full Changelog: https://github.com/huggingface/trl/compare/v0.23.0...v0.23.1