LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,809–2,832 of 4,121

warpfront

hipfire

★ 629

RDNA-native LLM inference engine in Rust.

Rust

Coolver

home-assistant-vibecode-agent

★ 628

Home Assistant MCP server agent. Enable Claude Code, Cursor, VS Code or any MCP-enabled IDE to help you vibe-code and manage Home Assistant: create and debug automations, design dashboards, tweak themes, modify configs, and deploy changes using natural language

Python

johnsonhk88

AI-Bank-Statement-Document-Automation-By-LLM-And-Personal-Finanical-Analysis-Prediction

★ 628

AI Bank Statement Document Automation By LLM model and Personal Finanical Analysis

Jupyter Notebook

jordanhubbard

nanolang

★ 628

A tiny experimental language designed to be targeted by coding LLMs

OtterMind

Nubase

★ 628

🔥🔥🔥 Turn AI-written code into real apps. Nubase is an open-source, AI-native backend platform for AI Coding, agentic applications, and modern product teams: Memory, Database, Storage, and Auth in one self-hostable service.

Java

samvallad33

vestige

★ 628

Vestige enhances agents by deterministic root-cause retrieval that reaches backward through time to find the quiet change, decision, or service that caused today’s failure, not the lookalike.

Rust

Sinholms

setup-gateway

★ 628

Konfigurator gateway OpenAI-compatible untuk Claude Code, OpenCode, dan Codex CLI. Zero-dependency, interaktif + CI, backup atomik + restore, config preservation, selftest built-in.

JavaScript

sou350121

VLA-Handbook

★ 628

本项目旨在为致力于进入VLA(Vision-Language-Action)领域的算法工程师提供一份全中文、实战导向的学习/面试手册。不同于通用的 CV/NLP 面试指南，本项目聚焦于 Robotics 特有的挑战

HTML

patrickjaja

claude-desktop-extra

★ 627

Unofficial Linux packages for Claude Desktop AI assistant with automated updates.

JavaScript

hashgraph-online

hol-guard

★ 626

Open-source antivirus for AI agents: block risky tools, secret access, prompt injection, malicious packages, MCP servers, plugins, and skills at runtime.

Python

hybridgroup

yzma

★ 626

Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

kangarooking

kangarooking-skills

★ 626

My custom AI Agent skills

Python

ufira-ai

Vibma

★ 626

Vibe Design meets Figma. Let AI agents design directly in Figma.

TypeScript

Light0305

Light-skills

★ 625

An AI workflow skill pack for research, competitions, and innovation projects.

Python

lukaszliniewicz

Pandrator

★ 625

Turn PDFs and EPUBs into audiobooks; subtitles or videos into dubbed videos (including translation), and more. For free. Pandrator uses local models, including voice-cloning (instant, RVC-enhanced, XTTS fine-tuning) and LLM processing. It aspires to be a user-friendly app with a GUI, an installer and all-in-one packages.

Python

ojuschugh1

sqz

★ 625

Compress LLM context to save tokens and reduce costs

Rust

Snailclimb

AIGuide

★ 624

AI 应用开发、AI 编程实战与面试指南，涵盖 LLM、Agent、RAG、MCP、Claude Code、Codex 等核心技术与工程实践。

redis

mcp-redis

★ 623

The official Redis MCP Server is a natural language interface designed for agentic applications to manage and search data in Redis efficiently

Python

Kc1t

alethe-agents

★ 622

A local-first desktop workspace for running, organizing, and resuming multiple coding agents and shells with real PTYs, split panes, persistent layouts, and local session history.

TypeScript