DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Fast and memory-efficient exact attention

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Optimizing AlphaFold Training and Inference on GPU Clusters

Efficient AI Inference & Serving

Documentation for Colossal-AI

Storing publicly available assets such as images, animations and texts

Open-Sora: Democratizing Efficient Video Production for All

Making large AI models cheaper, faster and more accessible