v0.33.0 — Accelerate

MUSA backend support and bugfixes

Small release this month, with key focuses on some added support for backends and bugs:

Support MUSA (Moore Threads GPU) backend in accelerate by @fmo-mt in https://github.com/huggingface/accelerate/pull/2917
Allow multiple process per device by @cifkao in https://github.com/huggingface/accelerate/pull/2916
Add torch.float8_e4m3fn format dtype_byte_size by @SunMarc in https://github.com/huggingface/accelerate/pull/2945
Properly handle Params4bit in set_module_tensor_to_device by @matthewdouglas in https://github.com/huggingface/accelerate/pull/2934

What's Changed

[tests] fix bug in torch_device by @faaany in https://github.com/huggingface/accelerate/pull/2909
Fix slowdown on init with device_map="auto" by @muellerzr in https://github.com/huggingface/accelerate/pull/2914
fix: bug where multi_gpu was being set and warning being printed even with num_processes=1 by @HarikrishnanBalagopal in https://github.com/huggingface/accelerate/pull/2921
Better error when a bad directory is given for weight merging by @muellerzr in https://github.com/huggingface/accelerate/pull/2852
add xpu device check before moving tensor directly to xpu device by @faaany in https://github.com/huggingface/accelerate/pull/2928
Add huggingface_hub version to setup.py by @nullquant in https://github.com/huggingface/accelerate/pull/2932
Correct loading of models with shared tensors when using accelerator.load_state() by @jkuntzer in https://github.com/huggingface/accelerate/pull/2875
Hotfix PyTorch Version Installation in CI Workflow for Minimum Version Matrix by @yhna940 in https://github.com/huggingface/accelerate/pull/2889
Fix import test by @muellerzr in https://github.com/huggingface/accelerate/pull/2931
Consider pynvml available when installed through the nvidia-ml-py distribution by @matthewdouglas in https://github.com/huggingface/accelerate/pull/2936
Improve test reliability for Accelerator.free_memory() by @matthewdouglas in https://github.com/huggingface/accelerate/pull/2935
delete CCL env var setting by @Liangliang-Ma in https://github.com/huggingface/accelerate/pull/2927
feat(ci): add pip caching in CI by @SauravMaheshkar in https://github.com/huggingface/accelerate/pull/2952

New Contributors

@HarikrishnanBalagopal made their first contribution in https://github.com/huggingface/accelerate/pull/2921
@fmo-mt made their first contribution in https://github.com/huggingface/accelerate/pull/2917
@nullquant made their first contribution in https://github.com/huggingface/accelerate/pull/2932
@cifkao made their first contribution in https://github.com/huggingface/accelerate/pull/2916
@jkuntzer made their first contribution in https://github.com/huggingface/accelerate/pull/2875
@matthewdouglas made their first contribution in https://github.com/huggingface/accelerate/pull/2936
@Liangliang-Ma made their first contribution in https://github.com/huggingface/accelerate/pull/2927
@SauravMaheshkar made their first contribution in https://github.com/huggingface/accelerate/pull/2952

Full Changelog: https://github.com/huggingface/accelerate/compare/v0.32.1...v0.33.0