LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,113–2,136 of 4,627

AnandChowdhary

continuous-claude

★ 1,382

🔂 Ralph loop with PRs: Run Claude Code in a continuous loop, autonomously creating PRs, waiting for checks, and merging

Shell

Aratako

Irodori-TTS

★ 1,382

A Flow Matching-based Text-to-Speech Model with Emoji-driven Style Control

Python

EvanZhouDev

openai-oauth

★ 1,382

Free AI with your ChatGPT account

TypeScript

hahhforest

pi-textbook

★ 1,382

《动手学 Pi》：沿 15 个真实 checkpoint 从零构建 Pi-style Agent

TypeScript

AutoArk

TinyEngram

★ 1,380

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Python

kimsungwhee

apple-docs-mcp

★ 1,380

MCP server for Apple Developer Documentation - Search iOS/macOS/SwiftUI/UIKit docs, WWDC videos, Swift/Objective-C APIs & code examples in Claude, Cursor & AI assistants

TypeScript

nvk

llm-wiki

★ 1,380

LLM-compiled knowledge bases for any AI agent. Parallel multi-agent research, thesis-driven investigation, source ingestion, wiki compilation, querying, and artifact generation.

Python

tmgthb

Autonomous-Agents

★ 1,380

Autonomous Agents (LLMs) research papers. Updated Daily.

awslabs

cli-agent-orchestrator

★ 1,379

Multi-agent orchestration for AI coding CLIs — Claude Code, Kiro, Codex, and more, coordinated in isolated tmux sessions

Python

cccyd2003-qwq

pinkbin

★ 1,379

扫盘 · 看懂 · 删除。磁盘扫描+清理Agent（Tauri 2 + React + Rust）

TypeScript

foxhui

WebAI2API

★ 1,378

WebAI2API: 基于 Camoufox 的网页 AI 转 API 工具，支持 LMArena/Gemini等，多窗口并发与账号隔离。 | Web AI to OpenAI API via Camoufox. Supports LMArena/Gemini and more, multi-window concurrency & account isolation.

JavaScript

heymrun

heym

★ 1,378

Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.

Python

nkzw-tech

codiff

★ 1,378

a fast local diff viewer

TypeScript

elevenyellow

handcrafted-persona-engine

★ 1,377

An AI-powered interactive avatar engine using Live2D, LLM, ASR, TTS, and RVC. Ideal for VTubing, streaming, and virtual assistant applications.

moyangzhan

langchain4j-aideepin

★ 1,375

基于AI的工作效率提升工具（聊天、绘画、知识库、工作流、 MCP服务市场、语音输入输出、长期记忆） | Ai-based productivity tools (Chat,Draw,RAG,Workflow,MCP marketplace, ASR,TTS, Long-term memory etc)

Java

Dataojitori

nocturne_memory

★ 1,374

A lightweight, rollbackable, and visual Long-Term Memory Server for MCP Agents. Say goodbye to Vector RAG and amnesia. Empower your AI with persistent, graph-like structured memory across any model, session, or tool. Drop-in replacement for OpenClaw.

Python

datawhalechina

zero-to-sglang

★ 1,374

Official SGLang × Datawhale course on LLM inference (中英双语): understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. 《从零手搓SGLang》：读懂推理，手搓 mini-sglang，吃透 SGLang 源码。

Python

ClaudioDrews

memory-os

★ 1,373

A 7-layer memory operating system for Hermes Agent — persistent memory with Qdrant, structured facts, fabric recall, auto-curated wiki, and surgical context injection. Runs locally, any LLM provider.

Python

firecrawl

open-scouts

★ 1,370

🔥 AI-powered web monitoring platform. Create automated scouts that search the web and send email alerts when they find what you're looking for.

TypeScript

jofizcd

Soul-of-Waifu

★ 1,370

🌌 Give a soul to your favorite characters. Soul of Waifu is a desktop roleplay & AI companion app featuring Live2D/VRM avatars, voice chat & local LLM. Evolve together across immersive chat, RPG adventures, and your desktop.

Python