LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

937–960 of 3,650

ogkalu2

comic-translate

★ 2,938

AI comic and manga translator app/browser extension for automatically translating comics, manga, manhwa, BDs, fumetti, and more in multiple languages and formats (Images, PDF, EPUB, CBR, CBZ etc).

Python

FB208

OpenBidKit_Yibiao

★ 2,934

This project helps teams deliver faster with open-source tooling and practical workflows.

JavaScript

qingchencloud

clawpanel

★ 2,930

🦞 OpenClaw & Hermes Agent 多引擎 AI 管理面板 — 内置 AI 助手（工具调用 + 图片识别 + 多模态），一键安装 | Tauri v2 跨平台桌面应用 | 11 种语言

JavaScript

intellectronica

ruler

★ 2,927

Ruler — apply the same rules to all coding agents

TypeScript

ascending-llc

jarvis-registry

★ 2,926

Connect any AI copilot or autonomous agent to your enterprise tools — through a single, secure MCP/Agent gateway with built-in identity, access control, and full observability.

Python

ax-llm

ax

★ 2,924

The pretty much "official" DSPy framework for Typescript

TypeScript

zjunlp

EasyEdit

★ 2,919

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

Jupyter Notebook

OpenMind

OM1

★ 2,914

Modular AI HAL (Hardware Abstraction Layer) for Robots

anthropics

commerce-agents

★ 2,909

Reference blueprint for building shopping and merchant agents with Claude. Examples in retail, commerce, telecom, and entertainment included.

Python

LLMQuant

quant-mind

★ 2,908

QuantMind is an agent-native knowledge extraction and retrieval framework for quantitative finance.

Python

bbruceyuan

Hands-On-Large-Language-Models-CN

★ 2,907

中文翻译的 Hands-On-Large-Language-Models (hands-on-llms)，动手学习大模型

Jupyter Notebook

MARKTECHPOST-AI-MEDIA-INC

AI-Agents-Projects-Tutorials

★ 2,903

Multi-agent systems, memory, planning, reasoning loops

Jupyter Notebook

op7418

Claude-to-IM-skill

★ 2,880

Bridge Claude Code / Codex to IM platforms — chat with AI coding agents from Telegram, Discord, or Feishu/Lark.

TypeScript

rohitg00

pro-workflow

★ 2,870

Claude Code learns from your corrections: self-correcting memory that compounds over 50+ sessions. Context engineering, parallel worktrees, agent teams, and 17 battle-tested skills.

JavaScript

ulab-uiuc

LLMRouter

★ 2,869

LLMRouter: An Open-Source Library for LLM Routing

Python

jnsahaj

lumen

★ 2,866

Beautiful git diff viewer, generate commits with AI, get summary of changes, all from the CLI

Rust

sopaco

deepwiki-rs

★ 2,864

Turn code into clarity. Generate accurate technical docs and AI-ready context in minutes—perfectly structured for human teams and intelligent agents.

Rust

Luce-Org

lucebox

★ 2,863

LLM speculative inference server for heterogeneous hardware & consumer GPUs

C++

kaitranntt

ccs

★ 2,856

Switch between Claude accounts, Gemini, Copilot, OpenRouter (300+ models) via CLIProxyAPI OAuth proxy. Visual dashboard, remote proxy support, WebSearch fallback. Zero-config to production-ready.

TypeScript