LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,825–1,848 of 4,627

jau123

MeiGen-AI-Design-MCP

★ 1,772

Supports GPT Image 2, Seedance & ComfyUI, with a 1,400+ prompt library, carefully crafted hooks and a multi-task orchestration system

TypeScript

AngusKit

AngusTester

★ 1,771

AI-native software testing platform — one YAML test language covering API, Web, mobile, messaging, data, and LLM scenarios. Self-hostable.

steven-jianhao-li

zotero-AI-Butler

★ 1,770

【Zotero AI 管家】调用大模型，自动精读论文库里的论文，总结为Zotero笔记。支持主流大模型平台！您只需像往常一样把文献丢进 Zotero，管家会自动帮您精读论文，将文章揉碎了总结为笔记，让您“十分钟完全了解”这篇论文！

TypeScript

lihanghang

NLP-Knowledge-Graph

★ 1,769

自然语言处理、知识图谱、对话系统，大模型等技术研究与应用。

Python

AIScientists-Dev

academic-humanizer

★ 1,767

Strip AI-writing tells from papers and grant proposals (NSF/NIH), while keeping scholarly voice and tying claims to evidence. A skill for Claude Code, Codex, and MorphMind.

RinDig

icm-architect

★ 1,767

Claude skill: design any process, idea, or problem into an ICM workspace (folder structure as agent architecture), or restructure an existing folder into one

signerlabs

Klee

★ 1,765

A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.

Swift

openai

mle-bench

★ 1,764

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

Python

AgentDock

★ 1,762

Build Anything with AI Agents

MDX

mylxsw

aidea-server

★ 1,762

AIdea 是一款支持 GPT 以及国产大语言模型通义千问、文心一言等，支持 Stable Diffusion 文生图、图生图、 SDXL1.0、超分辨率、图片上色的全能型 APP。

pawurb

hotpath-rs

★ 1,758

Rust profiler for CPU, memory, SQL, HTTP, and async performance, with Prometheus and Grafana support.

Rust

lyra81604

zhengxi-views

★ 1,751

可溯源的郑希(易方达基金经理)投研 Agent Skill——基于他全部公开观点原文 + 有原话佐证的投资方法 + 全市场基金真实数据，能溯源问答、按他框架给基金打分，绝不杜撰。⚠️仅研究学习辅助，不构成投资建议‼️website是郑希主页！

Python

software-mansion

react-native-executorch

★ 1,751

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

TypeScript

blitzdotdev

blitz-mac

★ 1,750

Native macOS App Store Connect tool with MCP. Submit iOS apps to App Store with AI agents

Swift

mex-memory

mex

★ 1,750

Team memory for engineers and their AI agents. Lives in your repo. Shared through Git.

TypeScript

relaticle

★ 1,750

Open-source CRM with native AI agent support. 37 MCP tools, REST API, self-hosted. Built with Laravel & Filament

PHP

Asymptote-Labs

agent-beacon

★ 1,749

Agent Beacon is the world's first open-source telemetry layer for AI agents wherever they run: locally, in CI, in the browser, or in the cloud.

Tencent

AngelSlim

★ 1,743

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Python

google

adk-java

★ 1,742

An open-source, code-first Java toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Java

NeoLabHQ

context-engineering-kit

★ 1,742

Hand-crafted Claude Code Skills focused on improving agent results quality. Compatible with OpenCode, Cursor, Antigravity, Gemini CLI, and others. Includes CodeRabbit open-source alternative.

TypeScript