LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

841–864 of 4,628

pguso

ai-agents-from-scratch

★ 4,825

Demystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns.

JavaScript

callstack

agent-device

★ 4,817

Mobile app automation and verification for AI coding agents. CLI, MCP server, and typed Node.js API for iOS, Android, HarmonyOS, TV, web, macOS, and Linux.

TypeScript

mlabonne

llm-datasets

★ 4,796

Curated list of datasets and tools for post-training.

breferrari

obsidian-mind

★ 4,791

A self-organizing Obsidian vault that gives AI coding agents persistent memory. Claude Code, Codex CLI, Gemini CLI.

TypeScript

ParisNeo

lollms-webui

★ 4,790

Lord of Large Language and Multi modal Systems Web User Interface

Python

chaitin

MonkeyCode

★ 4,781

AI coding platform for teams

TypeScript

AlphaGBM

skills

★ 4,778

Real-data options intelligence for AI agents — 29 Skills for Claude Code, Cursor & beyond

Python

Integuru-AI

Integuru

★ 4,773

The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.

Python

thunderbird

thunderbolt

★ 4,771

AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.

TypeScript

formkit

★ 4,769

The form framework for coding agents

TypeScript

skyzh

tiny-llm

★ 4,745

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

Python

ThePrimeagen

99

★ 4,743

Neovim AI agent done right

Lua

moshstudio

TAICHI-flet

★ 4,737

基于flet的一款windows桌面应用，实现了浏览图片、音乐、小说、漫画、各种资源的功能。

Python

rivet-dev

agentos

★ 4,736

Give agents an operating system as a library. Runs in your existing backend – no sandboxes, VMs, or SaaS. Powered by WebAssembly & V8 isolates.

Rust

infiniflow

infinity

★ 4,733

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

C++

origin-brain

beat-ai

★ 4,720

不玩晦涩不搞少数派的 AI 入门圣经，从学生到工程师都能轻松掌握。涵盖神经网络到大模型、顶层设计到微观原理、工程实现到算法基础。学完后，大家能彻底看懂为什么下一 token 预测这个看似不起眼的能力可以改变世界，也能发现原来 AI 并没有想象中那么神秘、那么高不可攀。 Let's just beat it !

JavaScript

conorbronsdon

avoid-ai-writing

★ 4,716

Skill that audits and rewrites content to remove AI writing patterns. Use it with your favorite agents including Claude Code, OpenClaw, Codex, and Hermes.

JavaScript

yangjian102621

geekai

★ 4,710

AI 助手全套开源解决方案，自带运营管理后台，开箱即用。集成了 ChatGPT, Azure, ChatGLM,讯飞星火，文心一言等多个平台的大语言模型。支持 MJ AI 绘画，Stable Diffusion AI 绘画，微博热搜等插件工具。采用 Go + Vue3 + element-plus 实现。

Vue