LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,449–2,472 of 4,631

RUC-NLPIR

Arbor

★ 1,096

A generalist autonomous research agent — runs experiments, researches, and iteratively optimizes, autonomously.

Python

crw

★ 1,096

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

Rust

LycheeMem

★ 1,095

Lightweight Long-Term Memory for LLM Agents.

Python

NVlabs

Fast-dLLM

★ 1,095

Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"

Python

Kieirra

murmure

★ 1,090

Fully local, private and cross platform Speech-to-Text with LLM Post-processing

Rust

chAng-L19

codex-redteam-mode

★ 1,089

针对于红队攻击思维做出的red team模式(破限项目，封号概不负责）##可自行适配其他Agent。项目问题请提issue

Python

yding-git

personal-edge-proxy

★ 1,089

A practical multi-inbound, multi-outbound personal proxy setup with Xray, Hysteria2, REALITY Vision, WARP and optional static SOCKS5 routing.

NirDiamant

Agent_Memory_Techniques

★ 1,087

Agent memory for LLMs: 30 runnable Jupyter notebooks covering conversation buffers, vector stores, knowledge graphs, episodic and semantic memory, MemGPT, Mem0, Letta, Zep, Graphiti, LoCoMo benchmarks, and production patterns.

Jupyter Notebook

obot-platform

obot

★ 1,087

Complete AI Governance Platform from Obot AI

Farama-Foundation

Stable-Retro

★ 1,086

A fork of gym-retro with additional games, emulators and supported platforms

C++

andrepimenta

claude-code-chat

★ 1,085

Beautiful Claude Code Chat Interface for VS Code

JavaScript

agents-io

PokeClaw

★ 1,084

PokeClaw (PocketClaw) — first on-device AI that controls your Android phone. Gemma 4, no cloud, no API key. Poke is short for Pocket.

Kotlin

nevalang

neva

★ 1,084

Dataflow programming language where you write a program as a message-passing graph and everything runs in parallel by default. It has strong static types, compiles to machine code, interoperates with Go, and supports visual programming with a node editor. Extremely LLM-friendly too.

weicj

vLLM-2080Ti-Definitive

★ 1,084

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 100+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )

Python

asklokesh

loki-mode

★ 1,083

Multi-agent autonomous SDLC framework. Spec to deployed app. PRD, GitHub issue, OpenAPI/JSON/YAML, or one-line brief. 5 AI providers, 8 quality gates.

Shell

cisco-ai-defense

mcp-scanner

★ 1,083

Scan MCP servers for potential threats & security findings.

Python

tigerowo

infinite-canvas

★ 1,083

开源 AI 创作工作台，集成无限画布、Agent、导演台、全景图、AI 生图、图片编辑、视频生成、画布编排等，兼容 OpenAI 接口及多种 API 服务

TypeScript

tigicion

dao-code

★ 1,083

Open-source TypeScript terminal coding agent for DeepSeek-V4 — builds on DeepSeek's strong price-performance and ultra-cheap cache pricing, engineering byte-stable prefixes and cache-reusing forks so cross-session memory and a continuous self-correction layer add almost no token cost; 1M context, Skills/MCP/Hooks, Claude Code config compatible.

TypeScript

K9i-0

ccpocket

★ 1,082

Mobile client for Codex and Claude — control coding agents from your phone via WebSocket bridge

Dart

chrisbanes

skills

★ 1,081

Skills for Kotlin, Jetpack Compose, and Android development

Python

helicalinsight

★ 1,081

Free, open source BI platform with AI conversational analytics (BYO-LLM), pixel-perfect paginated reports, interactive dashboards, SSO, embedding, multi-tenancy & row-level security. Every feature free in Community Edition. Self-hosted, Docker-ready

JavaScript