Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Run and customize Local LLMs.

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Dify in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ollama, qwen, GLM, deepseek, moonshot,doubao. Adapted to local llms, vlm, gguf such as llama-3.2, Linkage neo4j KG, graphRAG / RAG / html 2 img

Run AI ✨ assistant locally! with simple API for Node.js 🚀

Go manage your Ollama models

Tools for easing the handoff between AI/ML and App/SRE teams.

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

GGUF implementation in C as a library and a tools CLI program

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

Making offline AI models accessible to all types of edge devices.

Search for anything using Google, DuckDuckGo, phind.com, Contains AI models, can transcribe yt videos, temporary email and phone number generation, has TTS support, webai (terminal gpt and open interpreter) and offline LLMs

Gradio based tool to run opensource LLM models directly from Huggingface

An Interface for Deterministic Signals from Probabilistic LLM Vibes

😈 ImpAI is an advanced role play app using large language and diffusion models.

The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX commands or fluent human language

Open source and AI-powered web search engine: local, private, dockerized and supported by a fluffy llama🦙

run ollama & gguf easily with a single command

maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)