AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,281–2,304 of 4,627
datawhalechina

torch-rechub

★ 1,224

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

Jupyter Notebook
xianyu110

gpt-codex

★ 1,222

这是一个关于 OpenAI CodeX 的完整教程网站，专为国内开发者打造。

HTML
1CatAI

1Cat-vLLM

★ 1,221

V100 / SM70-focused vLLM engineering fork for modern LLM inference.

Python
moltlaunch

cashclaw

★ 1,221

An autonomous agent that takes work, does work, gets paid, and gets better at it.

TypeScript
mescon

Muximux

★ 1,220

A self-hosted homelab dashboard with an optional built-in reverse proxy that makes stubborn apps work in iframes

JavaScript
NVIDIA-NeMo

Gym

★ 1,220

Evaluate and improve models and agents using environments

Python
webbrain-one

webbrain

★ 1,219

Open-source AI browser agent for Chrome and Firefox (monorepo) 🧠

JavaScript
yeyupiaoling

Whisper-Finetune

★ 1,219

Fine-tune the Whisper speech recognition model to support training without timestamp data, training with timestamp data, and training without speech data. Accelerate inference and support Web deployment, Windows desktop deployment, and Android deployment

C
jieyefriic

rp-engine

★ 1,218

YAML-native agent workflow execution engine, written in Rust

Rust
EvolvingLMMs-Lab

LLaVA-OneVision-2

★ 1,216

Fully Open Framework for Democratized Multimodal Training

Python
★ 1,216

Create. Use. Share. ChatGPT prompts

JavaScript
Spark-To-Paper-Skills

paperjury

★ 1,215

Pre-submission AI review stress-test for research papers. A Claude Code skill: review, verdict, revise, verify.

JavaScript
langchain-ai

openevals

★ 1,214

Readymade evaluators for your LLM apps

Python
Zefan-Cai

R-KV

★ 1,214

[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

Python
★ 1,213

为纯文本模型"看图“设计更好的视觉工具箱和技能，支持多图理解，图片问答，前端UI还原、GUI 自动化等，并可选无缝接入多个主流agent，直接识别粘贴图片｜ A vision toolkit and skill designed for text-only llms — image Q&A, long-screenshot OCR, frontend UI restoration, and GUI automation, with optional seamless integration for Codex, Claude Code, Pi, Oh My Pi, and OpenCode

Python
ENTERPILOT

GoModel

★ 1,212

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

Go
superlinear-ai

raglite

★ 1,210

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Python
★ 1,210

A multi-llm Emacs shell (ChatGPT, Claude, DeepSeek, Gemini, Kagi, Ollama, Perplexity) + editing integrations

Emacs Lisp
ZHangZHengEric

Sage

★ 1,210

Multi-Agent System Framework For Complex Tasks

Python
★ 1,209

Open-source AI reverse-engineering agent platform and MCP server for Ghidra, Frida, x64dbg and Rizin — automated PE/APK/binary analysis, CTF and malware research, with 100+ MCP tools and a 194-article runnable knowledge base.

Python