v1.2.0: Bug Squashing & Fixes across the board

Core

• enable find_executable_batch_size on XPU by @faaany in https://github.com/huggingface/accelerate/pull/3236
• Use numpy._core instead of numpy.core by @qgallouedec in https://github.com/huggingface/accelerate/pull/3247
• Add warnings and fallback for unassigned devices in infer_auto_device_map by @Nech-C in https://github.com/huggingface/accelerate/pull/3066
• Allow for full dynamo config passed to Accelerator by @muellerzr in https://github.com/huggingface/accelerate/pull/3251
• [WIP] FEAT Decorator to purge accelerate env vars by @BenjaminBossan in https://github.com/huggingface/accelerate/pull/3252
• [data_loader] Optionally also propagate set_epoch to batch sampler by @tomaarsen in https://github.com/huggingface/accelerate/pull/3246
• use XPU instead of GPU in the accelerate config prompt text by @faaany in https://github.com/huggingface/accelerate/pull/3268

Big Modeling

• Fix align_module_device, ensure only cpu tensors for get_state_dict_offloaded_model by @kylesayrs in https://github.com/huggingface/accelerate/pull/3217
• Remove hook for bnb 4-bit by @SunMarc in https://github.com/huggingface/accelerate/pull/3223
• [docs] add instruction to install bnb on non-cuda devices by @faaany in https://github.com/huggingface/accelerate/pull/3227
• Take care of case when "_tied_weights_keys" is not an attribute by @fabianlim in https://github.com/huggingface/accelerate/pull/3226
• Update deferring_execution.md by @max-yue in https://github.com/huggingface/accelerate/pull/3262
• Revert default behavior of get_state_dict_from_offload by @kylesayrs in https://github.com/huggingface/accelerate/pull/3253
• Fix: Resolve #3060, preload_module_classes is lost for nested modules by @wejoncy in https://github.com/huggingface/accelerate/pull/3248

DeepSpeed

• Select the DeepSpeedCPUOptimizer based on the original optimizer class. by @eljandoubi in https://github.com/huggingface/accelerate/pull/3255
• support for wrapped schedulefree optimizer when using deepspeed by @winglian in https://github.com/huggingface/accelerate/pull/3266

Documentation

• Update code in tracking documentation by @faaany in https://github.com/huggingface/accelerate/pull/3235

• Replaced set/check breakpoint with set/check trigger in the troubleshooting documentation by @relh in https://github.com/huggingface/accelerate/pull/3259

• Update set-seed by @faaany in https://github.com/huggingface/accelerate/pull/3228

• Fix typo by @faaany in https://github.com/huggingface/accelerate/pull/3221

• Use real path for checkpoint by @faaany in https://github.com/huggingface/accelerate/pull/3220

• Fixed multiple typos for Tutorials and Guides docs by @henryhmko in https://github.com/huggingface/accelerate/pull/3274

New Contributors

• @winglian made their first contribution in https://github.com/huggingface/accelerate/pull/3266
• @max-yue made their first contribution in https://github.com/huggingface/accelerate/pull/3262
• @as12138 made their first contribution in https://github.com/huggingface/accelerate/pull/3261
• @relh made their first contribution in https://github.com/huggingface/accelerate/pull/3259
• @wejoncy made their first contribution in https://github.com/huggingface/accelerate/pull/3248
• @henryhmko made their first contribution in https://github.com/huggingface/accelerate/pull/3274

Full Changelog

• Fix align_module_device, ensure only cpu tensors for get_state_dict_offloaded_model by @kylesayrs in https://github.com/huggingface/accelerate/pull/3217
• remove hook for bnb 4-bit by @SunMarc in https://github.com/huggingface/accelerate/pull/3223
• enable find_executable_batch_size on XPU by @faaany in https://github.com/huggingface/accelerate/pull/3236
• take care of case when "_tied_weights_keys" is not an attribute by @fabianlim in https://github.com/huggingface/accelerate/pull/3226
• [docs] update code in tracking documentation by @faaany in https://github.com/huggingface/accelerate/pull/3235
• Add warnings and fallback for unassigned devices in infer_auto_device_map by @Nech-C in https://github.com/huggingface/accelerate/pull/3066
• [data_loader] Optionally also propagate set_epoch to batch sampler by @tomaarsen in https://github.com/huggingface/accelerate/pull/3246
• [docs] add instruction to install bnb on non-cuda devices by @faaany in https://github.com/huggingface/accelerate/pull/3227
• Use numpy._core instead of numpy.core by @qgallouedec in https://github.com/huggingface/accelerate/pull/3247
• Allow for full dynamo config passed to Accelerator by @muellerzr in https://github.com/huggingface/accelerate/pull/3251
• [WIP] FEAT Decorator to purge accelerate env vars by @BenjaminBossan in https://github.com/huggingface/accelerate/pull/3252
• use XPU instead of GPU in the accelerate config prompt text by @faaany in https://github.com/huggingface/accelerate/pull/3268
• support for wrapped schedulefree optimizer when using deepspeed by @winglian in https://github.com/huggingface/accelerate/pull/3266
• Update deferring_execution.md by @max-yue in https://github.com/huggingface/accelerate/pull/3262
• Fix: Resolve #3257 by @as12138 in https://github.com/huggingface/accelerate/pull/3261
• Replaced set/check breakpoint with set/check trigger in the troubleshooting documentation by @relh in https://github.com/huggingface/accelerate/pull/3259
• Select the DeepSpeedCPUOptimizer based on the original optimizer class. by @eljandoubi in https://github.com/huggingface/accelerate/pull/3255
• Revert default behavior of get_state_dict_from_offload by @kylesayrs in https://github.com/huggingface/accelerate/pull/3253
• Fix: Resolve #3060, preload_module_classes is lost for nested modules by @wejoncy in https://github.com/huggingface/accelerate/pull/3248
• [docs] update set-seed by @faaany in https://github.com/huggingface/accelerate/pull/3228
• [docs] fix typo by @faaany in https://github.com/huggingface/accelerate/pull/3221
• [docs] use real path for checkpoint by @faaany in https://github.com/huggingface/accelerate/pull/3220
• Fixed multiple typos for Tutorials and Guides docs by @henryhmko in https://github.com/huggingface/accelerate/pull/3274

Code Diff

Release diff: https://github.com/huggingface/accelerate/compare/v1.1.1...v1.2.0