LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,609–1,632 of 4,627

filtalgo

Filtmall-Shopping-Skill

★ 2,200

Agent-native shopping for extreme value: verifiable same-product price evidence, checkout, orders, delivery, and after-sales.

JavaScript

kevinluosl

deepbot

★ 2,199

DeepBot is a system-level AI assistant built for both personal productivity and enterprise workflows — one-click setup, seamless experience, and native Feishu integration.

TypeScript

HUANGCHIHHUNGLeo

claude-real-video

★ 2,190

Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT.

Python

lightseekorg

tokenspeed

★ 2,189

TokenSpeed is a speed-of-light LLM inference engine.

Python

beelzebub-labs

beelzebub

★ 2,188

A secure low code deception runtime framework, leveraging AI for System Virtualization.

carlvellotti

free-ai-courses

★ 2,187

Interactive course teaching Product Managers how to use Claude Code effectively

HTML

withcatai

node-llama-cpp

★ 2,186

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

TypeScript

Jazee6

cloudflare-ai-web

★ 2,185

Cloudflare AI Platform with one-click deployment

TypeScript

bmorcelli

Launcher

★ 2,182

Firmware Launcher for ESP32 boards like: M5Stack, Lilygo, Marauder and CYD devices.

C++

Dicklesworthstone

mcp_agent_mail

★ 2,179

Asynchronous coordination layer for AI coding agents: identities, inboxes, searchable threads, and advisory file leases over FastMCP + Git + SQLite

Python

MiniMax-AI

cli

★ 2,179

Generate text, images, video, speech, and music by MiniMax.

TypeScript

OpenCoworkAI

open-cowork

★ 2,179

Open-source AI agent desktop app for Windows & macOS. One-click install Claude Code, MCP tools, and Skills — with sandbox isolation, multi-model support, and Feishu/Slack integration.

TypeScript

samchon

nestia

★ 2,179

NestJS Helper + AI Chatbot Development

TypeScript

watercrawl

WaterCrawl

★ 2,179

Transform Web Content into LLM-Ready Data

TypeScript

ggml-org

llama.vim

★ 2,178

Vim plugin for LLM-assisted code/text completion

Vim Script

tandpfun

wardrobe

★ 2,177

Your clothes, extracted and organized with gpt-image.

JavaScript

alfredfrancis

ai-chatbot-framework

★ 2,171

A python chatbot framework with Natural Language Understanding and Artificial Intelligence.

TypeScript

theagentrouter

agent-router

★ 2,171

Manages Unified Access to Generative AI Services built on Envoy Gateway

0-AI-UG

cate

★ 2,169

An infinite zoomable canvas for coding. Editor, terminal, and browser panels in a spatial workspace.

TypeScript

777genius

agent-teams-ai

★ 2,166

You're the boss, agents are your team. They handle tasks on their own, message each other, and review each other's work. You just watch the kanban board and give high-level commands. Codex/Claude/OpenCode/Cursor/Grok/GitHub Copilot/Kiro/Z.AI/MiniMax/Kimi(200+ models, 75+ LLM providers, free models no auth). Build your AI company with multiple teams.

TypeScript

duty1g

x64dbg-mcp-server

★ 2,165

x64dbg-MCP Server is a native MCP (Model Context Protocol) plugin for x64dbg that exposes the debugger's full functionality over HTTP. Connect any MCP-compatible AI assistant and control x64dbg programmatically: set breakpoints, step through code, read memory, dump registers, and more. Built with Zig — zero dependencies, single-binary output, cros

Zig