LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

121–144 of 4,628

openai

skills

★ 27,767

Skills Catalog for Codex

Python

virattt

dexter

★ 27,628

An autonomous agent for deep financial research

TypeScript

Fosowl

agenticSeek

★ 27,237

Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity.

Python

vercel

ai

★ 26,904

The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

TypeScript

tashfeenahmed

freellmapi

★ 26,877

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind one /v1 endpoint, plus any custom OpenAI-compatible endpoint. Smart routing, automatic failover, encrypted keys. Personal experimentation only.

TypeScript

phuryn

pm-skills

★ 26,667

PM Skills Marketplace: 100+ agentic skills, commands, and plugins — from discovery to strategy, execution, launch, and growth.

deepset-ai

haystack

★ 26,615

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Python

OpenBMB

MiniCPM-V

★ 26,470

A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone

Python

zai-org

Open-AutoGLM

★ 26,312

An Open Phone Agent Model & Framework. Unlocking the AI Phone for Everyone

Python

mozilla-ai

llamafile

★ 25,984

Distribute and run LLMs with a single file.

C++

a2aproject

A2A

★ 25,964

Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.

Shell

promptfoo

★ 25,458

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

TypeScript

toon-format

toon

★ 25,437

🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

TypeScript

browserbase

stagehand

★ 25,387

The SDK For Browser Agents. Most existing browser automation tools either require you to write low-level code in a framework like Selenium, Playwright, or Puppeteer, or use high-level agents that can be unpredictable in production.

TypeScript

liguodongiot

llm-action

★ 25,062

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

HTML

vxcontrol

pentagi

★ 24,959

PentAGI runs fully autonomous AI agents for complex penetration testing, self-hosted and configurable with OpenAI, Anthropic, Ollama, and other LLM providers.

letta-ai

letta

★ 24,776

Platform for stateful agents: AI with advanced memory that can learn and self-improve over time.

activepieces

★ 24,752

AI Agents & MCPs & AI Workflow Automation • (~400 MCP servers for AI agents) • AI Automation / AI Agent with MCPs • AI Workflows & AI Agents • MCPs for AI Agents

TypeScript

Max-Eee

NeoPass

★ 24,484

Your Essential Exam Companion for the Iamneo Portal & NPTEL Exams Disguised as NeoExamShield bypass

JavaScript

NirDiamant

GenAI_Agents

★ 24,316

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

Jupyter Notebook

mksglu

context-mode

★ 24,223

Context window optimization for AI coding agents. Sandboxes tool output (98% reduction), persists session memory, and enforces routing across 17 platforms via MCP + hooks.

TypeScript