LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,017–2,040 of 4,627

ovg-project

kvcached

★ 1,513

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

mbzuai-oryx

Video-ChatGPT

★ 1,512

[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Python

YGYOOO

WorldX

★ 1,511

One sentence creates an AI-driven world — generate maps, characters, and watch stories emerge on their own. 一句话生成一个AI自主驱动的世界.

TypeScript

appleboy

CodeGPT

★ 1,506

A CLI written in Go language that writes git commit messages or do a code review brief for you using ChatGPT AI (gpt-4.1, gpt-4o model) and automatically installs a git prepare-commit-msg hook.

imxv

Pretty-mermaid-skills

★ 1,503

AI Agent Skill to generate and render beautiful Mermaid diagrams as SVG or terminal ASCII — 15 themes, 6 diagram types, batch CLI, no browser.

JavaScript

hyhmrright

brooks-lint

★ 1,502

AI code reviews grounded in 12 classic engineering books - decay risk diagnostics with book citations, severity labels, and 6 analysis modes including full-sweep auto-fix

JavaScript

e2b-dev

desktop

★ 1,499

E2B Desktop Sandbox for LLMs. E2B Sandbox with desktop graphical environment that you can connect to any LLM for secure computer use.

Python

elvisun

newsjack

★ 1,499

The open-source skills that turn your agent into a full PR team.

fynnfluegge

rocketnotes

★ 1,497

✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local or in the cloud

TypeScript

Open-Source-Legal

OpenContracts

★ 1,494

The open document intelligence platform for builders and hackers - DMS for the agentic world

Python

dyoshikawa

rulesync

★ 1,493

Rulesync is a developer tooling CLI that synchronizes AI agent rule sets, command templates, MCP settings, and ignore files with selective import/export flows for local and team workflows.

TypeScript

openonion

connectonion

★ 1,492

The Best AI Agent Framework for Agent Collaboration. Living Our Philosophy Step 1: Simple - Create and Use Step 2: Add Your Tools Step 3: Debug Your Agent Step 4: Production Ready Step 5: Multi-Agent - Make it Remotely Callable Why ConnectOnion?

Python

actionbook

rust-skills

★ 1,491

Rust Developer AI Assistance System — Meta-Problem-Driven Knowledge Indexing

Shell

octotools

★ 1,491

OctoTools: An agentic framework with extensible tools for complex reasoning

Python

nduckmink

arkon

★ 1,486

Arkon: Enterprise AI Knowledge Hub & MCP Server. Self-hosted knowledge base for teams to manage RAG contexts, access policies, and AI skills. Connect Claude and other LLMs via Model Context Protocol (MCP) for automated, secure organizational knowledge integration.

Python

robotmcp

ros-mcp-server

★ 1,482

Connect AI models like Claude & GPT with robots using MCP and ROS.

Python

najmuzzaman-mohammad

gawkbot

★ 1,481

open source grok bot. gawk bots automate your menial work via AI models and build you microapps to manage the outcome, so that you have a false sense of control.

valentinfrlch

ha-llmvision

★ 1,479

Visual intelligence for your home.

Python

cv-cat

XianYuApis

★ 1,478

闲鱼算法逆向，闲鱼api，websockets自动运营，咸鱼AI Agent基座

JavaScript

agent0ai

dox

★ 1,477

Self-documenting AGENTS.md

ghostwright

phantom

★ 1,476

An AI co-worker with its own computer. Self-evolving, persistent memory, MCP server, secure credential collection, email identity. Built on the Claude Agent SDK.

TypeScript