Perplexity AI Python client

Forecasting.

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, and more with your permission every step of the way.

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

A high-throughput and memory-efficient inference and serving engine for LLMs

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 12+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Template for any evals project using LLM apis

Chat language model that can use tools and interpret the results

Chat Templates for 🤗 HuggingFace Large Language Models

Training LLMs with QLoRA + FSDP

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, D…

Enforce the output format (JSON Schema, Regex etc) of a language model

Build AI Assistants with memory, knowledge and tools.

A benchmark to evaluate language models on questions I've previously asked them to solve.

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

Structured Text Generation

Comparison of Language Model Inference Engines

A library for making RepE control vectors

A repository for training nanogpt-based Chess playing language models.

A collection of different ways to implement accessing and modifying internal model activations for LLMs

METR Task Standard

Loop Habit Tracker, a mobile app for creating and maintaining long-term positive habits

Manage your dotfiles across multiple diverse machines, securely.

Pomodoro Logger 🕤 -- When a time tracker meets Pomodoro and Kanban board

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory