LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,153–1,176 of 4,628

langchain-ai

langgraphjs

★ 3,330

Framework to build resilient language agents as graphs.

TypeScript

yanliudesign

mono-color-skill

★ 3,324

One-ink editorial print image skill — warm paper, halftone photography, active negative space, and restrained typography.

Python

johnbean393

Sidekick

★ 3,317

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

Swift

wendy7756

AI-Video-Transcriber

★ 3,317

Transcribe and summarize videos and podcasts using AI. Open-source, multi-platform, and supports multiple languages.

Python

vectara

hallucination-leaderboard

★ 3,315

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

Python

mnemosyne-oss

mnemosyne

★ 3,312

Zero-cloud AI memory that works everywhere. SQLite-backed. One pure-Python dependency.

Python

agent-of-empires

★ 3,308

Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.

Rust

sentrux

★ 3,307

Real-time architectural sensor that helps AI agents close the feedback loop, enabling recursive self-improvement of code quality. Pure Rust.

Rust

Snailclimb

interview-guide

★ 3,307

基于 Spring Boot 4.1、Java 25、Spring AI 2.0、React、PostgreSQL/pgvector、Redis 和 RustFS 构建的开源 AI 面试平台，支持简历智能分析、模拟面试、语音面试和知识库 RAG。

Java

Norman-bury

research-writing-skill

★ 3,298

科研写作助手 (Research Writing Assistant)

Python

BBuf

how-to-optim-algorithm-in-cuda

★ 3,296

how to optimize some algorithm in cuda.

Cuda

rag-web-ui

★ 3,295

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

TypeScript

llm-as-a-verifier

★ 3,291

LLM-as-a-Verifier is a general-purpose framework that provides fine-grained feedback for any agent without requiring additional training. It achieves SOTA performance across coding, robotics, and medical agentic benchmarks.

Python

lmnr-ai

lmnr

★ 3,291

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

TypeScript

jehna

humanify

★ 3,290

Deobfuscate Javascript code using ChatGPT

Rust

timerring

bilive

★ 3,288

极快的B站直播录制、自动切片、自动渲染弹幕以及字幕并投稿至B站，综合多种模态模型，兼容超低配置机器。Extremely fast live recording, automatic slicing, rendering, uploading and Integrating MLLMs. Compatible with low configurations machines.

Python

Soju06

codex-lb

★ 3,285

Codex/ChatGPT multiple account load balancer & proxy with usage tracking, dashboard, and OpenCode-compatible endpoints

Python

neomjs

neo

★ 3,283

Neo.mjs is a self-evolving software organism: a professional end-to-end AI engineering team whose cross-model swarm inhabits live apps via Neural Link, Active Hybrid GraphRAG, DreamService, and self-healing loops.

JavaScript

nexu-io

nexu

★ 3,283

The simplest desktop client for OpenClaw 🦞 — bridge your Agent to WeChat, Feishu, Slack & Discord in one click. Works with Claude Code, Codex & any LLM. BYOK, Oauth, local-first, chat from your phone 24/7.

TypeScript

rsxdalv

TTS-WebUI

★ 3,278

A single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, MusicGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, and Bark!

TypeScript

pezzolabs

pezzo

★ 3,276

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

TypeScript