Releases Index

Accelerate

$npx @buildinternet/releases get accelerate
Mon
Wed
Fri
NovDecJanFebMarAprMayJunJulAugSepOctNov
Less
More
Releases2Avg0/wkVersionsv1.14.0 to v1.15.0
v1.15.0

Activation checkpointing now wraps the matched transformer layer instead of each child, cutting saved activations and memory at long sequence lengths; a new FSDP2-only activation_checkpointing_offload moves layer inputs to pinned CPU memory. Also added tied-embedding support on torch >= 2.13 and fixed gradient clipping and prepare_model for DTensor-sharded models.

Read more ↗
v1.14.0

Accelerate now works end-to-end on AMD ROCm devices. This release also includes numerous FSDP2 fixes and quality-of-life improvements, such as correct dtype handling on load, sharding of embeddings/norms, and QLoRA crash prevention.

Read more ↗
v1.10.0

N-D Parallelism Training large models across multiple GPUs can be complex, especially when combining different parallelism strategies (e.g TP, CP, DP). To simplify this process, we've collaborated with Axolotl to introduce an easy-to-use integration that allows you to apply any…

Read more ↗
v1.6.0

FSDPv2 support This release introduces the support for FSDPv2 thanks to @S1ro1. If you are using python code, you need to set fsdp_version=2 in FullyShardedDataParallelPlugin: If want to convert a YAML config that contains the FSDPv1 config to FSDPv2 one , use our conversion…

Read more ↗
v1.4.0

torchao FP8, initial Tensor Parallel support, and memory leak fixes torchao FP8 This release introduces a new FP8 API and brings in a new backend: torchao. To use, pass in AORecipeKwargs to the Accelerator while setting mixed_precision="fp8". This is initial support, as it…

Read more ↗
v1.3.0

Torch 2.0 As it's been 2 years since torch 2.0 was first released, we are now requiring this as the minimum version for Accelerate, which similarly was done in transformers as of its last release. Core [docs] no hard-coding cuda by @faaany in…

Read more ↗
Last Checked
22h ago
Latest
v1.15.0
Tracking since Mar 5, 2021