LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,201–1,224 of 3,650

lightseekorg

tokenspeed

★ 2,131

TokenSpeed is a speed-of-light LLM inference engine.

Python

ZJU4HealthCare

Foundations-of-Medical-LLMs

★ 2,129

Foundations of Medical Large Language Model Learning

AI-Anywhere

★ 2,126

Your agents. Any browser. Anywhere

TypeScript

benborla

mcp-server-mysql

★ 2,124

A Model Context Protocol server that provides read-only access to MySQL databases. This server enables LLMs to inspect database schemas and execute read-only queries.

JavaScript

jtmuller5

The-HustleGPT-Challenge

★ 2,123

Building Startups with an AI Co-Founder

777genius

agent-teams-ai

★ 2,117

You're the boss, agents are your team. They handle tasks on their own, message each other, and review each other's work. You just watch the kanban board and give high-level commands. Codex/Claude/OpenCode/Cursor/Grok/GitHub Copilot/Kiro/Z.AI/MiniMax/Kimi(200+ models, 75+ LLM providers, free models no auth). Build your AI company with multiple teams.

TypeScript

google-gemini

genai-processors

★ 2,116

GenAI Processors is a lightweight Python library that enables efficient, parallel content processing.

Python

VILA-Lab

Dive-into-Claude-Code

★ 2,114

A Systematic Analysis and Discussion of Claude Code for Designing Today's and Future AI Agent Systems

iFurySt

open-codex-computer-use

★ 2,106

👾 Open Computer Use – Open-Source Alternative to Codex Computer Use

Swift

theagentrouter

agent-router

★ 2,105

Manages Unified Access to Generative AI Services built on Envoy Gateway

aiwithremy

claude-skills-llm-council

★ 2,100

LLM Council — a Claude Code skill that runs your decisions through 5 AI advisors with peer review

neuron-core

neuron-ai

★ 2,096

The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI.

PHP

raphaelmansuy

edgequake

★ 2,094

EdegQuake 🌋 High-performance GraphRAG inspired from LightRag written in Rust; Transform documents into intelligent knowledge graphs for superior retrieval and generation

Rust

digitalsamba

claude-code-video-toolkit

★ 2,088

AI-native video production toolkit for Claude Code

Python

vitoplantamura

OnnxStream

★ 2,087

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

C++

NanoNets

docext

★ 2,086

An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)

Python

kacperkapusciak

goldie

★ 2,081

✨ agentic app store previews and screenshots

TypeScript

4thfever

cultivation-world-simulator

★ 2,080

基于 AI Agent 工作流的修仙世界模拟器，旨在还原智能、开放的仙侠世界。| An open-source Cultivation World Simulator using Agentic Workflow to create a dynamic, emerging Xianxia world.

Python

zhimaAi

chatwiki

★ 2,078

ChatWiki 微信公众号的AI知识库工作流Agent平台，RAG大模型AI客服机器人，致力于成为垂直领域的coze、n8n。

Vue

BetaStreetOmnis

xhs_ai_publisher

★ 2,076

AI-powered Xiaohongshu/Rednote content creation and publishing tool with PyQt desktop UI, FastAPI service, login-state reuse, preview publish, and automated browser workflows.

Python

maxritter

pilot-shell

★ 2,072

Professional context and harness engineering for Claude Code and OpenAI Codex. Build production-grade software with spec-driven development, TDD, persistent memory, quality gates, code intelligence, human oversight, and end-to-end verification.

JavaScript

vibheksoni

stealth-browser-mcp

★ 2,070

The only browser automation that bypasses anti-bot systems. AI writes network hooks, clones UIs pixel-perfect via simple chat.

Python

Lumiwealth

lumibot

★ 2,069

Backtestable AI trading agents and Python algorithmic trading strategies for stocks, options, crypto, futures, forex, SEC filings, FRED macro data, and real brokers.

Python

run-llama

llama_deploy

★ 2,068

Deploy your agentic worfklows to production

Python