DeepSpeed

Microsoft's large-scale distributed training / optimization library (ZeRO).

Role

Training

Maintainer

Microsoft

Languages

Python, CUDA

Stars

43K

Forks

4.9K

Open issues

1.3K

Last updated

today