LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

601–624 of 3,650

SCIR-HI

Huatuo-Llama-Med-Chinese

★ 4,993

Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调

Python

Anil-matcha

AI-Youtube-Shorts-Generator

★ 4,988

Open-source alternative to Opus Clip, Vidyo.ai, Klap & SubMagic. Turn long-form YouTube videos into viral 9:16 shorts using LLM highlight detection, Whisper transcription, and auto vertical cropping — free, no watermarks, no per-clip credits.

Python

mock-server

mockserver-monorepo

★ 4,971

MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.

Java

campfirein

byterover-cli

★ 4,963

ByteRover CLI (brv) - The portable memory layer for autonomous coding agents (formerly Cipher)

TypeScript

TabularisDB

tabularis

★ 4,961

Open-source desktop SQL workspace for PostgreSQL, MySQL/MariaDB, SQLite and 15+ more databases like DuckDB, ClickHouse, Redis and Firestore. Built-in MCP server for Claude, Cursor and Devin, SQL notebooks and visual EXPLAIN.

TypeScript

ag2ai

ag2

★ 4,931

AG2 (formerly AutoGen): The Open-Source AgentOS.Join us at: https://discord.gg/sNGSwQME3x

Python

getzep

zep

★ 4,914

Zep | Examples, Integrations, & More. It contains example code, framework integrations, and tools for building agent memory with Zep Cloud, Zep's managed agent memory platform.

Python

aipotheosis-labs

aci

★ 4,889

ACI.dev is the open source tool-calling platform that hooks up 600+ tools into any agentic IDE or custom AI agent through direct function calling or a unified MCP server. The birthplace of VibeOps.

Python

changyeyu

LLM-RL-Visualized

★ 4,883

🌟100+ 原创 LLM / RL 原理图📚，《大模型算法》作者巨献！💥（100+ LLM/RL Algorithm Maps ）

Python

darrenhinde

OpenAgentsControl

★ 4,858

AI agent framework for plan-first development workflows with approval-based execution. Multi-language support (TypeScript, Python, Go, Rust) with automatic testing, code review, and validation built for OpenCode

TypeScript

vinta

pangu.js

★ 4,826

Opinionated paranoid text spacing in JavaScript, with on-device AI semantic judgment

TypeScript

Waishnav

devspace

★ 4,810

Minimal Coding Agent Harness on MCP for ChatGPT, Claude, Hermes, Grok Bot, OpenClaw

TypeScript

pacifio

atlas

★ 4,800

Source control for agents. Use multiple coding agents, track their changes and query them in one place

Rust

langwatch

★ 4,793

The platform for LLM evaluations and AI agent testing

TypeScript

ParisNeo

lollms-webui

★ 4,789

Lord of Large Language and Multi modal Systems Web User Interface

Python

mlabonne

llm-datasets

★ 4,777

Curated list of datasets and tools for post-training.

xingkongliang

skills-manager

★ 4,777

A lightweight desktop app to manage, sync, and organize AI agent skills across 50+ coding tools — Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.

Rust