LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,905–2,928 of 4,123

matiasbattocchia

open-bsp-api

★ 592

Open-source WhatsApp + Instagram Business platform

TypeScript

strongdm

leash

★ 592

Leash by StrongDM - take your AI agents for a walk

StuMason

coolify-mcp

★ 592

MCP server for Coolify — 42 optimized tools for managing self-hosted PaaS through AI assistants

TypeScript

Trans-N-ai

swama

★ 592

High-performance MLX-based LLM inference engine for macOS with native Swift implementation

Swift

paperboytm

spool

★ 591

Store, share, and resume AI coding sessions.

TypeScript

lucienhuangfu

eLLM

★ 590

eLLM: Run Long-Horizon Inference Faster on CPUs Than on GPUs

Rust

ryanfrigo

kalshi-ai-trading-bot

★ 590

A toolkit for building AI-automated trading strategies on Kalshi prediction markets.

Python

sharpdeveye

maestro

★ 590

Workflow fluency for AI coding agents. 1 core skill · 25 commands · 7 domain references · memory layer · audit trail — works across Cursor, Claude Code, Gemini CLI, Copilot, and 6 more.

TypeScript

zosmaai

pi-llm-wiki

★ 590

Self-maintaining, Obsidian-compatible knowledge base for pi — turn raw sources into an interlinked wiki that compounds. Native Open Knowledge Format (OKF) v0.2.

TypeScript

felladrin

MiniSearch

★ 589

Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space

TypeScript

ramziddin

solid-skills

★ 589

AI agent skill for writing senior-engineer quality code through SOLID principles, TDD, and clean architecture

RennAkira

spicy-monopoly

★ 589

和你的 AI 一起玩的双人棋盘小游戏 · 18+ （A two-player board game you play with your AI — dice, tiles, spicy tasks, all run by code (18+））

Python

RobotecAI

rai

★ 589

RAI is a vendor agnostic agentic framework for Physical AI robotics, utilizing ROS 2 tools to perform complex actions, defined scenarios, free interface execution, log summaries, voice interaction and more.

Python

aldefy

compose-skill

★ 588

Jetpack Compose Agent Skill — AI-powered coding guidance with actual androidx/androidx source code receipts. Works with Claude Code, Codex CLI, Gemini CLI, Cursor, Copilot, Windsurf, and more.

Kotlin

gokayfem

ComfyUI_VLM_nodes

★ 588

ComfyUI nodes for vision-language models: Qwen3-VL, Moondream 3, Florence-2, SmolVLM2, InternVL, Gemma 3, MiniCPM-V. Plus open-vocabulary detection, SAM2/SAM3 segmentation, video temporal reasoning, GGUF via llama.cpp, and hosted LLM/VLM APIs.

Python

Nigh

show-me-the-story

★ 588

Self-hosted AI novel generator: single Go binary + web UI. OpenAI-compatible API → outline → chapter-by-chapter writing with review, foreshadowing, fact-check, and full-book polish. Chinese & English.

winstonkoh87

Athena-Public

★ 588

Athena is a local-first agentic PKM that helps you make better decisions with your own context — persistent memory, structured reasoning, and governed AI agents that work across any LLM. Own the state. Rent the intelligence.

Python

mnemon-dev

mnemon

★ 587

LLM-supervised persistent memory for AI agents — graph-based recall, cross-session knowledge, single binary. Works with DeepSeek Harness, Claude Code, OpenClaw, and any agent runtime.

stevesolun

ctx

★ 587

Repo-aware recommendations for skills, agents, MCP servers, and model harnesses. Use your own inventory or the shipped 79,958-node graph with 68,494 skills, 467 agents, 10,790 MCPs, and 207 harnesses.

Python