LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

217–240 of 3,650

yc-software

qm

★ 15,057

Multiplayer agent harness for work.

TypeScript

yusufkaraaslan

Skill_Seekers

★ 14,977

Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection

Python

botpress

★ 14,917

The open-source hub to build & deploy GPT/LLM Agents ⚡️

TypeScript

ConardLi

easy-dataset

★ 14,913

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

JavaScript

ifixai-ai

iFixAi

★ 14,899

Independent Auditing of AI Agents. Run by human or the agent itself, to answer the most crucial question in the AI Agent Economy. Is the agent doing what is supposed to do? With iFixAi you can have this answer in less than 120 seconds.

Python

xcanwin

KeepChatGPT

★ 14,897

这是一款提高ChatGPT的数据安全能力和效率的插件。并且免费共享大量创新功能，如：自动刷新、保持活跃、数据安全、取消审计、克隆对话、言无不尽、净化页面、展示大屏、拦截跟踪、日新月异、明察秋毫等。让我们的AI体验无比安全、顺畅、丝滑、高效、简洁。

JavaScript

millionco

react-doctor

★ 14,845

Your agent writes bad React. This catches it

TypeScript

llmware-ai

llmware

★ 14,843

Unified framework for building enterprise RAG pipelines with small, specialized models

Python

lidge-jun

opencodex

★ 14,746

Universal provider proxy for OpenAI Codex & Claude Code, use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code.

TypeScript

BlinkDL

RWKV-LM

★ 14,708

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Python

microsoft

RD-Agent

★ 14,643

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through R&D-Agent, which lets AI drive data-driven AI. 🔗https://aka.ms/RD-Agent-Tech-Report

Python

NVIDIA

TensorRT-LLM

★ 14,627

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python

NevaMind-AI

memU

★ 14,410

Personal memory across agents

Python

casdoor

★ 14,408

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

superset-sh

superset

★ 14,254

Superset is an agentic IDE to orchestrate 100+ coding agents in parallel. Run any agent with your own subscription.

TypeScript

CoplayDev

unity-mcp

★ 14,243

Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.

fathah

hermes-desktop

★ 14,228

Desktop Companion for Hermes Agent. Use it in Hermes One by selecting Atlas Cloud as your provider.

TypeScript

waooAI

waoowaoo

★ 14,096

首家工业级全流程 AI 影视生产平台。Industry-first professional AI Agent platform for controllable film & video production. From shorts to live-action with Hollywood-standard workflows.

TypeScript