LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

3,193–3,216 of 4,151

ome-projects

ome

★ 509

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

richardr1126

openreader

★ 509

An open-source read-along document reader server with high-quality TTS options, synchronized highlighting, and audiobook export for EPUB, PDF, DOCX, TXT, and MD.

TypeScript

tony1223

better-agent-terminal

★ 509

Multi-workspace terminal aggregator with Claude Code AI integration

TypeScript

WILLOSCAR

research-units-pipeline-skills

★ 509

Research pipelines as semantic execution units: each skill declares inputs/outputs, acceptance criteria, and guardrails. Evidence-first methodology prevents hollow writing through structured intermediate artifacts.

Python

youssefHosni

LLM-Open-University-From-Begineer-to-Advanced

★ 509

A complete roadmap to master LLMs from absolute beginners to advanced

antonbabenko

terraform-aws-devops

★ 508

Info about many of my Terraform, AWS, DevOps, and AI (tada!) projects.

BrowserOperator

browser-operator-core

★ 508

Browser Operator - The AI browser with built in Multi-Agent platform! Open source alternative to ChatGPT Atlas, Perplexity Comet, Dia and Microsoft CoPilot Edge Browser

TypeScript

gakonst

nanocodex

★ 508

Building blocks for frontier OpenAI agents in Rust. Nanocodex empowers you with Codex-level performance anywhere.

Rust

ollama4j

★ 508

A simple Java library for interacting with Ollama server.

Java

penpot

penpot-mcp

★ 508

Penpot's official MCP Server

TypeScript

VoltAgent

official-design-md

★ 508

Official DESIGN.md files published by companies themselves. First-party design systems that AI agents read to generate consistent UI.

waybarrios

opencode-power-pack

★ 508

54 rigorous skills for Codex, OpenCode, and Pi: code review, security audit, feature development, frontend design, MCP tools, Hugging Face ML/training, and more.

Python

cordum-io

cordum

★ 507

The action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.

duckbugio

flock

★ 507

Autonomous AI dev-team bot

iusztinpaul

designing-real-world-ai-agents-workshop

★ 507

Hands-on workshop: Build a multi-agent AI system from scratch — Deep Research Agent + Writing Workflow served as MCP servers. Includes code, slides, and video

Python

reyamira

models

★ 507

TUI and CLI for browsing AI models, benchmarks, coding agents, and statuses for AI providers.

Rust

vladimir-kharin

1c_mcp

★ 507

Инструмент для создания MCP-серверов в 1С:Предприятие путем разработки расширения конфигурации. Позволяет интегрировать данные и функциональность 1С с AI-ассистентами (Claude, Cursor и т.д.). Включает Python-прокси и пример расширения 1С с готовыми инструментами.

1C Enterprise

Yuzzyuk

marketing-os

★ 507

An entire marketing department as one Claude skill. 14 modules: audits scored 0-100, an 18-tactic hook engine, copy graded before you see it, ad diagnosis, GEO, email, launches, pricing. Works in Claude, Codex and Cursor.

1mcp-app

agent

★ 506

A unified Model Context Protocol server implementation that aggregates multiple MCP servers into one.

TypeScript

aannoo

hcom

★ 506

Let AI agents message, watch, and spawn each other across terminals. Claude Code, Codex, Antigravity CLI, Cursor CLI, OpenCode, Kilo, Pi, Kimi

Rust

avibe-bot

avibe

★ 506

The local-first Agent OS — your AI partner lives on your own machine. Drive the official Claude Code, Codex & OpenCode from your browser or any chat app.

Python