LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

817–840 of 4,628

developersdigest

llm-answer-engine

★ 5,038

Perplexity Inspired Answer Engine

TypeScript

SCIR-HI

Huatuo-Llama-Med-Chinese

★ 4,997

Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Python

mock-server

mockserver-monorepo

★ 4,980

MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.

Java

RyanFitzgerald

devportfolio

★ 4,980

A modern, minimalist portfolio template built with Astro and Tailwind CSS. Perfect for developers looking to showcase their skills, experience, and projects in a clean, professional way.

Astro

going-doer

Paper2Code

★ 4,975

Paper2Code: Automating Code Generation from Scientific Papers in Machine Learning

Python

ag2ai

ag2

★ 4,970

AG2 (formerly AutoGen): The Open-Source AgentOS.Join us at: https://discord.gg/sNGSwQME3x

Python

FellouAI

eko

★ 4,963

Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

TypeScript

campfirein

byterover-cli

★ 4,961

ByteRover CLI (brv) - The portable memory layer for autonomous coding agents (formerly Cipher)

TypeScript

awslabs

aidlc-workflows

★ 4,942

AI-Driven Life Cycle (AI-DLC) adaptive workflow steering rules for AI coding agents

TypeScript

getzep

zep

★ 4,942

Zep | Examples, Integrations, & More. It contains example code, framework integrations, and tools for building agent memory with Zep Cloud, Zep's managed agent memory platform.

Python

changyeyu

LLM-RL-Visualized

★ 4,928

🌟100+ 原创 LLM / RL 原理图📚，《大模型算法》作者巨献！💥（100+ LLM/RL Algorithm Maps ）

Python

homeassistant-ai

ha-mcp

★ 4,910

The Unofficial and Awesome Home Assistant MCP Server

Python

didilili

ai-agents-from-zero

★ 4,906

🚀 2026 最系统的 AI Agent 速成指南｜智能体实战教程 · 完整学习路径 + 实战项目 + 面试题库 · 对标大模型应用开发工程师岗位 · 覆盖LangChain / LangGraph / Coze / Dify / MCP / skills / LLM / RAG / 提示词 · 企业级部署与微调 · 从0到企业级落地 + 从学习到上线项目 + 面试准备一体化

Python

Martian-Engineering

lossless-claw

★ 4,903

Lossless Claw — LCM (Lossless Context Management) plugin for OpenClaw

TypeScript

aipotheosis-labs

aci

★ 4,899

ACI.dev is the open source tool-calling platform that hooks up 600+ tools into any agentic IDE or custom AI agent through direct function calling or a unified MCP server. The birthplace of VibeOps.

Python

langwatch

★ 4,896

The platform for LLM evaluations and AI agent testing

TypeScript

darrenhinde

OpenAgentsControl

★ 4,886

AI agent framework for plan-first development workflows with approval-based execution. Multi-language support (TypeScript, Python, Go, Rust) with automatic testing, code review, and validation built for OpenCode

TypeScript

neilsonnn

image-blaster

★ 4,884

An image-to-world skillset for Claude.

TypeScript

ethanniser

NextFaster

★ 4,880

A highly performant e-commerce template using Next.js

TypeScript

atilaahmettaner

tradingview-mcp

★ 4,878

TradingView MCP server — real-time market data, technical analysis, screeners & backtesting for Claude, ChatGPT, Cursor & any MCP client. Stocks, crypto, forex & futures across global exchanges. Hosted or self-host.

Python