TRL

Highlights

• General decoder model support in addition to GPT-2 in https://github.com/lvwerra/trl/pull/53
• Encoder-decoder model support (such as T5) in https://github.com/lvwerra/trl/pull/93
• New, shiny docs with the doc-builder in https://github.com/lvwerra/trl/pull/59
• push_to_hub with PPOTrainer in https://github.com/lvwerra/trl/pull/68
• Simple reference model creation with layer sharing in https://github.com/lvwerra/trl/pull/61

What's Changed

• Remove nbdev dependency by @younesbelkada in https://github.com/lvwerra/trl/pull/52
• Adds github actions and dummy test by @edbeeching in https://github.com/lvwerra/trl/pull/55
• Update README.md by @Keith-Hon in https://github.com/lvwerra/trl/pull/51
• Update README.md by @TristanThrush in https://github.com/lvwerra/trl/pull/49
• Adds Python highlighting to the code block by @JulesGM in https://github.com/lvwerra/trl/pull/45
• xxxForCausalLM support by @younesbelkada in https://github.com/lvwerra/trl/pull/53
• [VHead] Fix slow convergence issue by @younesbelkada in https://github.com/lvwerra/trl/pull/60
• add docbuilder skeleton by @lvwerra in https://github.com/lvwerra/trl/pull/59
• fix docs workflow by @lvwerra in https://github.com/lvwerra/trl/pull/63
• accelerate integration by @younesbelkada in https://github.com/lvwerra/trl/pull/58
• add create_reference_model by @lvwerra in https://github.com/lvwerra/trl/pull/61
• Improve Makefile and code quality by @lvwerra in https://github.com/lvwerra/trl/pull/62
• Relax requirements by @lvwerra in https://github.com/lvwerra/trl/pull/66
• modeling - change namings by @younesbelkada in https://github.com/lvwerra/trl/pull/65
• [PPOTrainer] make the reference model optional by @younesbelkada in https://github.com/lvwerra/trl/pull/67
• Improvements 1a by @edbeeching in https://github.com/lvwerra/trl/pull/70
• update GitHub actions to main by @lvwerra in https://github.com/lvwerra/trl/pull/77
• [core] refactor step method by @younesbelkada in https://github.com/lvwerra/trl/pull/76
• [PPOTrainer] Support generic optimizers by @younesbelkada in https://github.com/lvwerra/trl/pull/78
• Update sentiment_tuning.mdx by @eltociear in https://github.com/lvwerra/trl/pull/69
• Remove references to "listify_batch" by @xiaoyesoso in https://github.com/lvwerra/trl/pull/81
• Collater -> collator by @LysandreJik in https://github.com/lvwerra/trl/pull/88
• Model as kwarg in pipeline by @LysandreJik in https://github.com/lvwerra/trl/pull/89
• Small typo correction by @LysandreJik in https://github.com/lvwerra/trl/pull/87
• [API] Make dataset attribute optional by @younesbelkada in https://github.com/lvwerra/trl/pull/85
• [Doc] Improve docs by @younesbelkada in https://github.com/lvwerra/trl/pull/91
• [core] Push v_head when using AutoModelForCausalLMWithValueHead by @younesbelkada in https://github.com/lvwerra/trl/pull/86
• [core] remove wandb dependency by @younesbelkada in https://github.com/lvwerra/trl/pull/92
• add logo by @lvwerra in https://github.com/lvwerra/trl/pull/95
• Encoder-Decoder models support by @younesbelkada in https://github.com/lvwerra/trl/pull/93
• Fix docs hyperlinks by @lewtun in https://github.com/lvwerra/trl/pull/98
• [API] LR scheduler support by @younesbelkada in https://github.com/lvwerra/trl/pull/96
• Version should have dev0 unless it is a release version by @mishig25 in https://github.com/lvwerra/trl/pull/99
• [core] improve API by @younesbelkada in https://github.com/lvwerra/trl/pull/97
• Add push to Hub for PPOTrainer by @lewtun in https://github.com/lvwerra/trl/pull/68
• [core] Advise to use fbs=1 by @younesbelkada in https://github.com/lvwerra/trl/pull/102
• [Doc] New additions by @younesbelkada in https://github.com/lvwerra/trl/pull/105
• restructure examples by @lvwerra in https://github.com/lvwerra/trl/pull/107
• Fix nits & missing things by @younesbelkada in https://github.com/lvwerra/trl/pull/108
• Convert notebook 05 by @edbeeching in https://github.com/lvwerra/trl/pull/80

New Contributors

• @lvwerra made their first contribution in https://github.com/lvwerra/trl/pull/2
• @vblagoje made their first contribution in https://github.com/lvwerra/trl/pull/16
• @dependabot made their first contribution in https://github.com/lvwerra/trl/pull/26
• @younesbelkada made their first contribution in https://github.com/lvwerra/trl/pull/52
• @edbeeching made their first contribution in https://github.com/lvwerra/trl/pull/55
• @Keith-Hon made their first contribution in https://github.com/lvwerra/trl/pull/51
• @TristanThrush made their first contribution in https://github.com/lvwerra/trl/pull/49
• @JulesGM made their first contribution in https://github.com/lvwerra/trl/pull/45
• @eltociear made their first contribution in https://github.com/lvwerra/trl/pull/69
• @xiaoyesoso made their first contribution in https://github.com/lvwerra/trl/pull/81
• @LysandreJik made their first contribution in https://github.com/lvwerra/trl/pull/88
• @lewtun made their first contribution in https://github.com/lvwerra/trl/pull/98
• @mishig25 made their first contribution in https://github.com/lvwerra/trl/pull/99

Full Changelog: https://github.com/lvwerra/trl/commits/v0.2.0