LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,377–2,400 of 4,602

DeepMyst

Mysti

★ 1,140

AI coding dream team of agents for VS Code. Claude Code + openai Codex collaborate in brainstorm mode, debate solutions, and synthesize the best approach for your code.

TypeScript

codelibs

fess

★ 1,139

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.

Java

mrwadams

stride-gpt

★ 1,139

An AI-powered threat modeling tool that leverages OpenAI's GPT models to generate threat models for a given application based on the STRIDE methodology.

Python

sunblaze-ucb

exploitgym

★ 1,139

ExploitGym is a large-scale, realistic benchmark built from real-world vulnerabilities designed to evaluate AI agents' ability to develop exploits.

agentrq

★ 1,138

AgentRQ: Human-in-loop realtime conversational task manager for AI Agents. Self-hosted! Control your own agents from wherever you want Mobile, Web, Desktop. Designed to work well with your own Claude subscriptions and any harness with ACP support.

elastic

elastic-labs

★ 1,138

Notebooks & Example Apps for Search, Observability, and Security with Elasticsearch

Jupyter Notebook

DannyMac180

fable-advisor

★ 1,137

Claude Fable as an orchestrator for Opus, GPT and Grok

massgen

MassGen

★ 1,136

🚀 MassGen is an open-source multi-agent scaling system that runs in your terminal, autonomously orchestrating frontier models and agents to collaborate, reason, and produce high-quality results. | Join us on Discord: discord.massgen.ai

Python

jingcheng-chen

rhinomcp

★ 1,135

RhinoMCP connects Rhino 3D to AI Agent through the Model Context Protocol (MCP)

Python

matlab

matlab-agentic-toolkit

★ 1,134

The MATLAB Agentic Toolkit brings trusted MATLAB capabilities to AI agents, making engineering and scientific workflows agent-ready.

MATLAB

NativeMindBrowser

NativeMindExtension

★ 1,134

NativeMind: Your fully private, open-source, on-device AI assistant

TypeScript

BagelHole

DevOps-Security-Agent-Skills

★ 1,133

Agent-ready DevOps, security, infrastructure, and compliance knowledge base with 80+ skills across Kubernetes, Terraform, AWS/Azure/GCP, AI platform operations, container hardening, SOC2/ISO27001, and incident response—plus ready-to-run scripts, templates, and playbooks for SRE, platform, and security teams.

Shell

NovaSearch-Team

RAG-Retrieval

★ 1,133

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

Python

autonomous-ai

openharness

★ 1,132

The ultimate harness for coding agents and beyond. All your agents. All your machines. One command center. Start with code, then follow your curiosity and build across disciplines: CAD, circuits, robots, games and music.

Dart

TencentCloudBase

CloudBase-AI-Toolkit

★ 1,132

Backend for AI coding agents on CloudBase — database, auth, functions via Plugin, Skills & MCP.

TypeScript

HarryR

z80ai

★ 1,131

Z80-μLM is a 2-bit quantized language model small enough to run on an 8-bit Z80 processor. Train conversational models in Python, export them as CP/M .COM binaries, and chat with your vintage computer.

Python

huangjia2019

claude-code-engineering

★ 1,131

This repository demonstrates how to use Claude Code to do real engineering work, not just writing code. 本项目是极客时间专栏《Claude Code 工程化实战》的官方配套示例仓库，目标就是： 👉 把 Claude Code 从“对话式编码工具”，变成可设计、可复用、可治理的工程系统。

JavaScript

KroMiose

nekro-agent

★ 1,129

NekroAgent 是一个面向多人互动场景的跨平台 Agent 框架，集 Claude Code 沙盒执行、工作区编排、长期记忆、结构化 MCP 管理与可视化控制台于一体，兼具高扩展性、多模态交互、实时状态推送和自动化运行能力。项目支持 QQ、Discord、Telegram、Minecraft、BilibiliLive、WeChat、Email、SSE(SDK) 等多种平台接入，应用于构建高智能聊天机器人，可扩展为具备代码执行、工具调用、插件协作和复杂任务处理能力的通用 Agent 系统

Python