Upstream Accelerate #273

Job	Run time
Test examples differences	46s
Test Stable Diffusion	37m 1s
Test DeepSpeed models	1h 10m 41s
Test FSDP models	6m 55s
Test multi-card models	2h 52m 31s
Test single-card models	33m 52s
Test text-generation example	2h 27m 14s
Test TRL integration	1m 32s
Test Sentence Transformers integration	3m 34s
Test Accelerate integration	9s
	7h 54m 15s

Provide feedback