LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

673–696 of 4,628

om-ai-lab

VLM-R1

★ 6,028

Solve Visual Understanding with Reinforced VLMs

Python

PawanOsman

OpenCursor

★ 6,027

Open-source Cursor-like AI coding agent for VS Code — agentic chat, multi-provider LLMs (OpenAI, Ollama, llama.cpp), semantic search, and MCP support

TypeScript

deusyu

harness-engineering

★ 6,023

Harness Engineering 学习指南 — 从概念理解到独立实践的深度学习档案

JavaScript

browser-act

skills

★ 6,012

Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.

Python

gluonfield

enchanted

★ 6,007

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Swift

arthelokyo

astrowind

★ 6,006

⭕️ AstroWind: A free template using Astro v7 and Tailwind CSS v4. Astro starter theme.

Astro

Q00

ouroboros

★ 6,003

Agent OS: the agent gets smarter on its own. We just hold the line: Interview-gated, staged evaluation, budgeted evolution loop. MCP server, 14 runtimes: Claude Code, Codex CLI, Gemini CLI, OpenCode, Copilot, Kiro and more.

Python

vllm-project

semantic-router

★ 5,990

A programmable Mixture-of-Models router for heterogeneous LLM inference

FlorianBruniaux

claude-code-ultimate-guide

★ 5,985

The most comprehensive Claude Code guide: agentic workflows, hooks, skills, MCP servers, quizzes, and production-ready templates. 430K+ lines.

Python

Mai-with-u

MaiBot

★ 5,981

MaiSaka, an LLM-based intelligent agent, is a digital lifeform devoted to understanding you and interacting in the style of a real human. She does not pursue perfection, nor does she seek efficiency; instead, she values warmth, authenticity, and genuine connection.

Python

kuafuai

DevOpsGPT

★ 5,967

Multi agent system for AI-driven software development. Combine LLM with DevOps tools to convert natural language requirements into working software. Supports any development language and extends the existing code.

HTML

clusterzx

paperless-ai

★ 5,953

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

JavaScript

kserve

★ 5,952

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

lucidrains

x-transformers

★ 5,951

A concise but complete full-attention transformer with a set of promising experimental features from various papers

Python

21st-dev

magic-mcp

★ 5,949

It's like v0, but in your Cursor / Claude Code / Windsurf: search 10,000+ React/Tailwind components, generate new UI with AI, and publish your own — right from your editor. Magic MCP is now the 21st MCP; this package keeps old configs working. Setup: 21st.dev/mcp

TypeScript

amazon-science

chronos-forecasting

★ 5,932

Chronos: Pretrained Models for Time Series Forecasting

Python

fengshao1227

ccg-workflow

★ 5,916

多模型协作工作流引擎 — /ccg:go 一个命令，AI 自动分析意图、选择策略、编排 Codex + Gemini + Claude 协作执行

ModelEngine-Group

nexent

★ 5,890

Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles, unified tools, skills, memory, and orchestration with built-in constraints, feedback loops, and control planes.

Python

pbek

QOwnNotes

★ 5,889

QOwnNotes is a plain-text file notepad and todo-list manager with Markdown support and Nextcloud / ownCloud integration.

C++

KellerJordan

modded-nanogpt

★ 5,883

NanoGPT (124M) in 90 seconds

Python

AgentOps-AI

agentops

★ 5,856

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Python