LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,065–2,088 of 3,650

garylab

MakeMoneyWithAI

★ 939

A list of open-source AI projects you can use to generate income easily.

Python

Optim-Agent

optim-agent

★ 939

LLM agents as your hyperparameter optimizer.

Python

fluffypony

dothething

★ 938

an autonomous AI agent: you describe the thing, it does the thing.

Shell

bgauryy

octocode

★ 937

Code research platform for AI agents; find, understand, and prove context across your code and all of GitHub, in a fraction of the tokens. One toolset, MCP or CLI

TypeScript

kaplanelad

shellfirm

★ 934

Safety guardrails for ai coding agents and human terminal commands

Rust

qinshihu

itops-agent-platform

★ 934

China's 1st enterprise multi-agent IT ops platform. LLM-powered auto-remediation for Zabbix/Prometheus. Docker deploy.

TypeScript

kossakovsky

selfhost-ai

★ 933

🚀 Self-hosted AI automation platform. Deploy n8n, Ollama, Flowise, RAG, Supabase & 30+ tools with one command. Auto HTTPS. Free Zapier/Make alternative.

Shell

inngest

agent-kit

★ 931

AgentKit: Build multi-agent networks in TypeScript with deterministic routing and rich tooling via MCP.

TypeScript

openvinotoolkit

model_server

★ 931

A scalable inference server for models optimized with OpenVINO™

C++

Renset

macai

★ 931

All-in-one native macOS AI chat application for virtually any AI provider

Swift

tigerless-labs

agent-memory

★ 931

Long-term memory runtime for AI agents — plain Markdown as the source of truth, local ranked retrieval, and an independent sleep-time Manage layer. Claude Code and Codex share one store. No API key.

Python

luongnv89

asm

★ 930

The universal skill manager for AI coding agents.

TypeScript

QuantGeekDev

mcp-framework

★ 930

The Typescript MCP Framework

TypeScript

investbrainapp

investbrain

★ 929

Smart LLM-enabled investment tracker that consolidates and monitors market performance across your different brokerages

PHP

MatthewZMD

aidermacs

★ 929

AI Pair Programming in Emacs with Aider

Emacs Lisp

SylphxAI

pdf-reader-mcp

★ 929

Give your AI agent eyes for PDFs — structured text, tables, OCR, visual evidence, and page-level citations via MCP. Native Rust, local-first.

TypeScript

usewhale

Whale

★ 928

Whale — blazingly fast, terminal-first AI coding agent for DeepSeek. ~98% prompt cache hit rate, 1M context, MCP tools, dynamic workflows.

CopilotKit

aimock

★ 927

Mock everything your AI app talks to — LLM APIs, MCP, A2A, AG-UI, vector DBs, search. One package, one port, zero dependencies.

TypeScript

friuns2

codex-mobile

★ 927

🚀 Run Codex Mobile Anywhere: Linux, Windows, or Termux on Android 🚀

TypeScript

datawhalechina

zero-to-sglang

★ 926

Official SGLang × Datawhale course on LLM inference (中英双语): understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. 《从零手搓SGLang》：读懂推理，手搓 mini-sglang，吃透 SGLang 源码。

Python