LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,489–1,512 of 3,650

allenai

dolma

★ 1,545

Data and tools for generating and inspecting OLMo pre-training data.

Python

RTGS2017

NagaAgent

★ 1,543

A simple yet powerful agent framework for personal assistants, designed to enable intelligent interaction, multi-agent collaboration, and seamless tool integration.

Python

BlackSnufkin

LitterBox

★ 1,542

A self-hosted sandbox for red teams to test payloads against modern detection before deployment. MCP integration lets an LLM agent drive analysis end to end.

YARA

kenryu42

cc-safety-net

★ 1,542

A pre-execution guard for AI coding agents. It blocks destructive Git and file system commands, plus common attempts to access sensitive files, before a tool call runs. Supports Amp Code, Antigravity CLI, Claude Code, Codex, Cursor, Gemini CLI, GitHub Copilot CLI, Grok Build, Hermes Agent, Kimi Code, OpenClaw, OpenCode, and Pi.

TypeScript

RayBytes

ChatMock

★ 1,542

OpenAI & Ollama compatible API powered by Codex

Python

zeronsh

zeron

★ 1,542

A native control plane for Claude Code, Codex, Cursor, Devin and other coding agents.

Rust

GitHamza0206

simba

★ 1,541

OpenSource Production ready Customer service with built in Evals and monitoring

TypeScript

AminForou

mcp-gsc

★ 1,539

Google Search Console Insights with Claude AI for SEOs

Python

PaperDebugger

paperdebugger

★ 1,539

A Plugin-Based Multi-Agent System for In-Editor Academic Writing, Review, and Editing

TypeScript

QwenAudio

Fun-ASR

★ 1,539

Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.

QuantaAlpha

★ 1,536

QuantaAlpha transforms how you discover quantitative alpha factors by combining LLM intelligence with evolutionary strategies. Just describe your research direction, and watch as factors are automatically mined, evolved, and validated through self-evolving trajectories.

Python

cookiy-ai

user-research-skill

★ 1,535

Cookiy AI Skill for AI agents (Claude, Codex, Cursor, OpenClaw) — end-to-end user research: AI interviews, synthetic users, quant surveys, participant recruitment.

Shell