Inference and training library for high-quality TTS models.

Extract clean markdown from PDFs, URLs, Word docs, slides, videos, and more, ready for any LLM. ⚡

Just some stuff for Interview questions, books, annotated paper, notes, cheat sheets etc etc related to ML,AI, Deep Learning and Data Science

OpenAI compatible API for TensorRT LLM triton backend

🧠💬 Articles I wrote about machine learning, archived from MachineCurve.com.

AI powered one-click comprehensive docs from transcripts and text.

Machine Learning Engineering Open Book

This repository contains tutorials and examples for Triton Inference Server

A high-throughput and memory-efficient inference and serving engine for LLMs

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

A bagel, with everything.

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding