A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

An open-source framework for training large multimodal models.

A resilient distributed training framework

(NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Example code showing how to use Nvidia DALI in pytorch, with fallback to torchvision. Contains a few differences to the official Nvidia example, namely a completely CPU pipeline & improved memory u…

Distributed, mixed-precision training with PyTorch

Multithreaded Python without the GIL

🎓 Path to a free self-taught education in Computer Science!

Unofficial PyTorch Reimplementation of RandAugment.

The source code of NuevoMatch as described in "A Computational Approach to Packet Classification" (SIGCOMM, 2020)

Implementation of PLELog in ICSE 2021 accepted paper:Semi-supervised Log-based Anomaly Detection via Probabilistic Label Estimation.