The accompanying code for "Memory-efficient Transformers via Top-k Attention" (Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonathan Berant. SustaiNLP 2021).

The Transformer model implemented from scratch using PyTorch. The model uses weight sharing between the embedding layers and the pre-softmax linear layer. Training on the Multi30k machine translati…

Ranger deep learning optimizer rewrite to use newest components

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Scalene: a high-performance, high-precision CPU, GPU, and memory profiler for Python with AI-powered optimization proposals

a Hassle-Free Python Experience

dev tools, env vars, task runner

A plugin manager for Fish

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

StableSwarmUI, A Modular Stable Diffusion Web-User-Interface, with an emphasis on making powertools easily accessible, high performance, and extensibility.

Upscaling stable diffusion latents using a small neural network.

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

Enhancements & experiments for ComfyUI, mostly focusing on UI features

Fast Stable Diffusion CLI +Gradio

Supercharge Your Model Training

Thoth-Station ArgoCD Applications

Dependency solver for the Thoth project

Modern, extensible Python project management

A one-of-a-kind resume builder that keeps your privacy in mind. Completely secure, customizable, portable, open-source and free forever. Try it out today!

Serve, optimize and scale PyTorch models in production

Finally, a JSONPath implementation for Python that aims to be standard compliant. That's all. Enjoy!

Exploring Go from a Scala developer prespective.

Executes commands in response to file modifications

Simple Python version management

Watches for changes in a directory tree and reruns a command in an acme win or just on the terminal.

A set of tools to keep your pinned Python dependencies fresh.

ClickHouse Python Driver with native interface support