Inference Llama 2 in one file of pure C

LLM training in simple, raw C/CUDA

🎉 CUDA Learn Notes with PyTorch: fp32、fp16/bf16、fp8/int8、flash_attn、sgemm、sgemv、warp/block reduce、dot prod、elementwise、softmax、layernorm、rmsnorm、hist etc.

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

Making large AI models cheaper, faster and more accessible

Text-to-video generation: CogVideoX (2024) and CogVideo (ICLR 2023)

learning how CUDA works

LLM inference in C/C++

SGLang is a fast serving framework for large language models and vision language models.

交易模块

The simplest, fastest repository for training/finetuning medium-sized GPTs.

[🔥updating ...] AI 自动量化交易机器人(完全本地部署) AI-powered Quantitative Investment Research Platform. 📃 online docs: https://ufund-me.github.io/Qbot ✨ :news: qbot-mini: https://github.com/Charmve/iQuant

基于Python的开源量化交易平台开发框架

Inference code for Llama models

The official Meta Llama 3 GitHub site

NoSQL data store using the SEASTAR framework, compatible with Redis

NoSQL data store using the seastar framework, compatible with Apache Cassandra

A high-throughput and memory-efficient inference and serving engine for LLMs

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

A collection of modern/faster/saner alternatives to common unix commands.

k8s tutorials | k8s 教程

High Performance Embedded Key-Value Store

KubeBlocks is an open-source control plane software that runs and manages databases, message queues and other stateful applications on K8s.

[SIGMOD 2023] High-Dimensional Approximate Nearest Neighbor Search: with Reliable and Efficient Distance Comparison Operations

🦜🔗 Build context-aware reasoning applications

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and…

notes on papers/books/codes

Pika is a Redis-Compatible database developed by Qihoo's infrastructure team.

PyTorch code and models for the DINOv2 self-supervised learning method.

eight-legged essay for MySQL. Just a learning Project