LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

337–360 of 3,650

lencx

Noi

★ 9,052

🚀 Less chaos. More flow.

TypeScript

iflytek

astron-agent

★ 9,016

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

Java

multimodal-art-projection

YuE

★ 8,891

YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing.

Python

bentoml

BentoML

★ 8,842

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Python

nexu-io

html-anything

★ 8,835

✨ The agentic HTML editor — your local AI agent writes the HTML, you ship it. 🚀 75 Skills × 9 Surfaces (magazine · deck · poster · XHS / tweet · prototype · data report · Hyperframes) 🛡️ Sandboxed preview · 📤 1-click to WeChat / X / Zhihu / HTML / PNG 🔑 Zero API key — Claude Code / Cursor / Codex / Gemini / Copilot / OpenCode / Qwen / Aider.

HTML

fishaudio

Bert-VITS2

★ 8,800

vits2 backbone with multilingual-bert

Python

google

adk-go

★ 8,793

An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

justlovemaki

AIClient2API

★ 8,779

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro, OpenAI, Claude, and custom providers. Supports OpenAI-compatible API, Claude API, Gemini protocol conversion, GPT, Grok Build, Claude Opus, Gemini Pro, Kimi, MiniMax, provider pools, smart routing, and automatic failover.

JavaScript

Vincentwei1021

video-shotcraft

★ 8,768

AI video skill for Claude Code & Codex — cinematic product videos with Remotion: 152 shot recipe cards, 209 motion previews, a production-ready template

TypeScript

rockbenben

ChatGPT-Shortcut

★ 8,761

Stop writing prompts from scratch — a searchable prompt library for ChatGPT, Claude, Gemini and Cursor · Русский 한국어 العربية हिन्दी ไทย ｜别再从头写提示词：现成的拿来就用，好用的收进自己的库

TypeScript

Maciek-roboblog

Claude-Code-Usage-Monitor

★ 8,706

Real-time Claude Code usage monitor with predictions and warnings

Python

microsoft

TypeChat

★ 8,685

TypeChat is a library that makes it easy to build natural language interfaces using types.

TypeScript

0xPlaygrounds

rig

★ 8,646

⚙️🦀 Build modular and scalable LLM Applications in Rust

Rust

poloclub

transformer-explainer

★ 8,580

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

JavaScript

liyupi

codefather

★ 8,552

程序员鱼皮的编程宝典 ⭐️ 2026年最全编程学习路线图！包含Java学习路线、前端学习路线、Python学习路线、C++学习路线、算法学习路线、计算机基础学习路线、AI应用开发学习路线、AI Agent开发学习路线等。提供编程入门教程、AI大模型应用开发教程、RAG开发实战、MCP开发教程、Prompt工程指南、LLM应用开发、技术知识分享、学习资源推荐、项目实战教程、热门面试题、求职经验、简历优化、编程自学指南等内容，适用于所有零基础学编程、学习AI开发、转行程序员、计算机专业学生、求职找工作的同学 💎 编程学习，就来编程导航！

TypeScript

OpenBMB

XAgent

★ 8,545

An Autonomous LLM Agent for Complex Task Solving

Python

bitsandbytes-foundation

bitsandbytes

★ 8,478

Accessible large language models via k-bit quantization for PyTorch.

Python

THUDM

slime

★ 8,478

slime is an LLM post-training framework for RL Scaling.

Python

bytedance

flowgram.ai

★ 8,453

FlowGram is an extensible workflow development framework with built-in canvas, form, variable, and materials that helps developers build AI workflow platforms faster and simpler.

TypeScript

jeecgboot

jimureport

★ 8,436

一款真正的 AI 报表诞生了！JimuChatBI —— 首款免费开源对话式智能数据分析产品（Chat2BI）。一句话生成报表和数据大屏，支持对话式 AI 修改优化；类 Excel 在线报表设计，兼容国产信创数据源。对着 AI 说句话，报表就出来了——表格、图表、分组汇总自动生成，复杂报表场景轻松应对。想做数据大屏？同样一句话搞定，让数据分析进入 AI 时代。

Java