LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,617–2,640 of 4,117

n2ns

antigravity-panel

★ 704

Community toolkit for Google Antigravity IDE. Quota dashboard (Gemini/Claude/GPT), usage trends + runway prediction, cache manager (Brain Tasks & Code), auto-accept mode, AI commit generator. 13 languages.

TypeScript

pegainfer-project

pegainfer

★ 704

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Rust

s0ld13rr

pentestcode

★ 704

PentestCode - Multi-agent AI penetration testing system with persistent engagement state, strategic coordination, and parallel autonomous operations.

TypeScript

eternityspring

reelbench-skills

★ 703

Learning notes and tooling skills for AI video - AI 视频相关的学习与工具 skill

HTML

NomaDamas

CozyClay

★ 703

Open source previs software in the browser: block a scene, pose characters, author camera moves and cuts, then take the same shots to an AI video model.

JavaScript

liliu-z

stashbase

★ 702

Turn your local files into a Wiki for your agents. Open-source and local-first.

TypeScript

tugcantopaloglu

openclaw-dashboard

★ 702

🔐 Secure, real-time monitoring dashboard for OpenClaw AI agents. Auth, TOTP MFA, cost tracking, live feed, memory browser and more.

HTML

vybestack

llxprt-code

★ 702

An open-source multi-provider AI assisted CLI development tool. Use whatever LLM you want to code in your terminal.

TypeScript

agentscope-ai

Trinity-RFT

★ 701

Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (LLM).

Python

tinyflow-ai

tinyflow

★ 700

Tinyflow is a lightweight AI agent solution.

Svelte

voocel

openclaw-mini

★ 699

🦞 OpenClaw 核心架构的极简复现，涵盖 sessionKey 会话域、队列串行、工具化记忆检索、按需上下文加载、可扩展技能与主动心跳唤醒机制

TypeScript

frontman-ai

frontman

★ 698

The AI agent that lives in your framework/browser

ReScript

JordanCoin

codemap

★ 698

a project brain for your AI. Give LLMs instant architectural context without burning tokens

heliocosta-dev

revenue-centric-design

★ 697

Product-design, conversion & behavioral-science principles for SaaS

Python

Qiuner

claude-nexus

★ 697

An all-in-one enhancement suite for Claude.ai - folder management, timeline navigation, and chat export in one powerful extension.

TypeScript

CommonstackAI

UncommonRoute

★ 696

Automatic LLM router — 82% cost savings, 79.4% accuracy, 93.4% pass rate. Drop-in OpenAI proxy.

Python

panxunying

ai-coding-welfare

★ 696

AI Coding 福利站导航：免费白嫖 Claude Code / Codex 的中转站与公益站合集，含额度、模型、价格自动更新与一键配置脚本

JavaScript

caspianmoon

memoripy

★ 695

Evidence-first local memory for AI agents with temporal versions, admission policies, citations, explainable recall, MCP, and audit tooling.

Python

Deuz-AI

Deuz-SDK

★ 695

Zero-dependency TypeScript framework for production AI agents: durable execution, long-term memory, hybrid RAG, MCP tool calling, human-in-the-loop approval, planning and CodeAct sandboxes. One streaming API for Claude, GPT, Gemini, Grok, Mistral and DeepSeek — Node, Bun, Deno, serverless and edge.

TypeScript

pdovhomilja

nextcrm-app

★ 695

NextCRM — Open-source CRM built with Next.js 16, React 19, PostgreSQL, Prisma 7, and shadcn/ui. CRM, projects, invoicing, documents, email client & AI features.

TypeScript