DeepSpeed

Microsoft's large-scale distributed training / optimization library (ZeRO).

Role

Training

Maintainer

Microsoft

Languages

Python, CUDA

Stars

43K

Forks

5.0K

Open issues

1.4K

Last updated

today