LLM inference in C/C++

The simplest, fastest repository for training/finetuning medium-sized GPTs.

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

Model components of the Llama Stack APIs

3D Visualization of an GPT-style LLM

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Start building and deploying Python packages and Docker images for MLOps tasks.

Learn ML engineering for free in 4 months!

100 Days of ML Coding

All Algorithms implemented in Python

A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"

Machine Learning Interviews from FAANG, Snapchat, LinkedIn. I have offers from Snapchat, Coupang, Stitchfix etc. Blog: mlengineer.io.

AdalFlow: The library to build & auto-optimize any LLM tasks.

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

Free MLOps course from DataTalks.Club

A natural language interface for computers

SwinIR: Image Restoration Using Swin Transformer (official repository)

SwinIR: Image Restoration Using Swin Transformer (official repository)

Testcontainers is a Python library that providing a friendly API to run Docker container. It is designed to create runtime environment to use during your automatic tests.

A Native-PyTorch Library for LLM Fine-tuning

Kickstart your MLOps initiative with a flexible, robust, and productive Python package.

CLI to manage your datacontract.yaml files

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs