LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,249–1,272 of 3,650

Andrew-Jang

RAGHub

★ 1,999

A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evolving RAG ecosystem.

msoedov

agentic_security

★ 1,999

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

Python

patterns-ai-core

langchainrb

★ 1,997

Build LLM-powered applications in Ruby

Ruby

win4r

AISuperDomain

★ 1,996

Aila(AI超元域): The premier AI integration tool for Windows, macOS, and Android. Ask once, get answers from 10+ AIs like ChatGPT, Gemini, Claude3, Copilot, Poe, perplexity and more. Features customizable AI and prompts.

Orkas-AI

Orkas

★ 1,988

Open-source multi-agent AI desktop client — build and command your AI agent team through conversation. A commander LLM dispatches sub-agents in parallel or in series; agents self-evolve via reflection and skill crystallization. Local-first, BYO LLM keys (Claude · OpenAI · Gemini · DeepSeek · Kimi · GLM · Qwen). macOS / Windows / Linux.

TypeScript

nhaouari

obsidian-textgenerator-plugin

★ 1,985

Text Generator is a versatile plugin for Obsidian that allows you to generate text content using various AI providers, including OpenAI, Anthropic, Google and local models.

TypeScript

aws

amazon-q-developer-cli

★ 1,983

✨ Agentic chat experience in your terminal. Build applications using natural language.

Rust

ymcui

Chinese-LLaMA-Alpaca-3

★ 1,982

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

Python

glittercowboy

taches-cc-resources

★ 1,980

A collection of my favorite custom Claude Code resources to make life easier.

TypeScript

haykgrigo3

TimeCapsuleLLM

★ 1,975

A LLM trained only on data from certain time periods to reduce modern bias

Python

mudler

LocalAGI

★ 1,973

LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for OpenAI's Responses APIs with advanced agentic capabilities. No clouds. Local AI that works on consumer-grade hardware (CPU and GPU).

diudiu-tech

delivery-harness

★ 1,968

AI harness reference implementation for on-demand delivery workflows

Java

duty1g

x64dbg-mcp-server

★ 1,967

x64dbg-MCP Server is a native MCP (Model Context Protocol) plugin for x64dbg that exposes the debugger's full functionality over HTTP. Connect any MCP-compatible AI assistant and control x64dbg programmatically: set breakpoints, step through code, read memory, dump registers, and more. Built with Zig — zero dependencies, single-binary output, cros

Zig

StanfordBDHG

HealthGPT

★ 1,965

Query your Apple Health data with natural language 💬 🩺

Swift

Pinvou

pinvou-agent

★ 1,960

Open-source desktop AI agent for tools, files, knowledge, workflows, and real deliverables.

Rust

AntigmaLabs

ante

★ 1,956

Ghost in your shell. Ante is a self-contained agent harness with a highly optimized core. It works like Claude Code or Codex, with none of their dependencies or model constraints.

Rust

numtide

llm-agents.nix

★ 1,949

Nix packages for AI coding agents and development tools. Automatically updated daily.

Nix

Trystan-SA

claude-design-system-prompt

★ 1,947

Reverse-engineered system prompt and skill library that turns an LLM into an opinionated, accessibility-aware, AI-slop-resistant design collaborator.

doobidoo

mcp-memory-service

★ 1,946

Open-source persistent memory for AI agent pipelines (LangGraph, CrewAI, AutoGen) and Claude. REST API + knowledge graph + autonomous consolidation.

Python

AI4Finance-Foundation

FinRL-Meta

★ 1,940

FinRL®-Meta: Dynamic datasets and market environments for FinRL.

Python

kubewall

★ 1,938

kubewall - Kubernetes Dashboard for Multi-Cluster Management Real-Time, Self-Hosted, Single Binary, AI-powered. Manage, monitor & debug K8s clusters in your browser, no cloud, no agents.

TypeScript