LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,297–1,320 of 3,650

irinabuht12-oss

google-meta-ads-ga4-mcp

★ 1,881

Google Ads MCP + Meta Ads MCP + GA4 in one server for Claude, ChatGPT, Cursor & n8n — 250+ tools, hosted remote MCP, OAuth login, no API keys. By Ryze AI.

deer-flow

llm-space

★ 1,880

A desktop app to prototype agent ideas, inspect every harness step, replay failures, and evaluate performance, all in one place. Local-first, cloud-ready for managed agents.

TypeScript

ROCm

FastFlowLM

★ 1,879

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

C++

zakirkun

guardian-cli

★ 1,879

Guardian is a production-ready AI-powered penetration testing automation CLI tool that leverages Google Gemini and LangChain to orchestrate intelligent, step-by-step penetration testing workflows while maintaining ethical hacking standards.

Python

nndeploy

★ 1,878

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

C++

yoanbernabeu

grepai

★ 1,873

Semantic Search & Call Graphs for AI Agents (100% Local)

Eronred

aso-skills

★ 1,868

AI agent skills for App Store Optimization (ASO) and app marketing. Built for indie developers, app marketers, and growth teams who want Cursor, Claude Code, or any Agent Skills-compatible AI assistant to help with keyword research, metadata optimization, competitor analysis, and app growth.

MDX

MixLabPro

comfyui-mixlab-nodes

★ 1,862

Workflow-to-APP、ScreenShare&FloatingVideo、GPT & 3D、SpeechRecognition&TTS

JavaScript

dphnAI

sonar

★ 1,860

Large-scale LLM inference engine

Python

stephengpope

thepopebot

★ 1,860

The Pope Bot is an autonomous AI agent that you can configure and build to do just about anything you want, all day, everyday, 24/7.

JavaScript

xenodium

agent-shell

★ 1,860

A native Emacs buffer to interact with LLM agents powered by ACP

Emacs Lisp

ray-project

llm-applications

★ 1,857

A comprehensive guide to building RAG-based LLM applications for production.

Jupyter Notebook

eneskirca

nodeterm

★ 1,851

Node-based terminal manager for AI coding agents — tmux-backed terminals and parallel agent sessions as draggable nodes on an infinite pan/zoom canvas. macOS, Linux, and a browser Server Edition.

TypeScript

sunmh207

AI-Codereview-Gitlab

★ 1,847

基于大模型(DeepSeek,OpenAI等)的 GitLab 自动代码审查工具；支持钉钉/企业微信/飞书推送消息和生成日报；支持Docker部署；可视化 Dashboard。

Python

XiaomingX

indie-hacker-tools-plus

★ 1,847

为独立开发者准备的精选技术栈和工具仓库来了！这里有你最需要的工具，帮你提升开发效率、节约成本，最重要的是——这些工具都是市场上热门的，经过验证的。🚀A curated collection of tech stacks and tools tailored for independent developers is here! these are proven, popular tools widely used in the industry. 🚀