LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,873–1,896 of 4,627

emarco177

langchain-course

★ 1,696

A project-based course repository for developing AI agents using LangChain v1+ and LangGraph: search agents, RAG systems, reflection agents, and code interpreters.

gi-dellav

zerostack

★ 1,696

Lightweight coding agent written in Rust, optimized for memory footprint and performance

Rust

tenstorrent

tt-metal

★ 1,696

TT-NN operator library, and TT-Metalium low level kernel programming model.

C++

Gitlawb

zero

★ 1,694

The coding agent that answers to you, your model, your machine, your rules.

legeling

PromptHub

★ 1,691

一款包含了 Prompt管理，Skill管理，Agent管理的一站式AI工具箱，助你高效管理提示词，一键分发skills ，一站式管理Agent资产，并实现云同步，备份，版本管理 | An all-in-one AI toolbox for prompt, agent, and skills management. Reuse prompts, distribute skills with one click, manage agent assets, and support cloud sync, backup, and version control

TypeScript

skyllwt

AutoSci

★ 1,691

Karpathy's LLM-Wiki vision, fully realized — wiki-centric full-lifecycle AI research platform powered by Claude Code

Python

VictorTaelin

OptMem

★ 1,689

Permanent memory for AI agents. A 426-token prompt, a script, plug and play.

Python

gnehs

subtitle-translator-electron

★ 1,688

↔️ Translate subtitle using LLM

TypeScript

LjyYano

Thinking_in_Java_MindMapping

★ 1,686

编程笔记、 AI 学习、观影指南、读书笔记、生活感悟、游戏记录

Python

Lynpoint

CyberVerse

★ 1,685

Self hosted, real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.

Python

OpenOSINT

★ 1,685

AI-powered OSINT agent with interactive REPL, MCP server, and CLI. 19 tools. Works with Claude, GPT-4, or local models. For authorized security research only.

Python

bytedance

Sa2VA

★ 1,682

Official Repo For Pixel-LLM Codebase: Sa2VA (T-PAMI-26), SAMTok (CVPR-26), VRT (Arxiv-25), SaSaSa2VA (1-st solution for LSVOS)

Python

AgentR1

Agent-R1

★ 1,680

Agent-R1: Training Powerful LLM Agents with End-to-End Reinforcement Learning

Python

absadiki

subsai

★ 1,679

🎞️ Subtitles generation tool (Web-UI + CLI + Python package) powered by OpenAI's Whisper and its variants 🎞️

Python

devenjarvis

lathe

★ 1,679

Generate hands-on, multi-part technical tutorials on demand, with LLM skills tuned to make content approachable. Then you work through them yourself, by hand ✋

shiwenwen

hope-agent

★ 1,678

🦭 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手，也可服务化常驻 NAS / 云端 | A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment

Rust

intentee

paddler

★ 1,676

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Rust

AvdLee

Swift-Concurrency-Agent-Skill

★ 1,673

Add expert Swift Concurrency guidance to your AI coding tool (Agent Skills open format): safe concurrency, performance optimization, and Swift 6 migration.