LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

553–576 of 3,650

modstart-lib

aigcpanel

★ 5,556

AIGCPanel 是一个简单易用的一站式AI数字人系统，支持视频合成、声音合成、声音克隆，简化本地模型管理、一键导入和使用AI模型。

TypeScript

bbycroft

llm-viz

★ 5,539

3D Visualization of an GPT-style LLM

TypeScript

father-bot

chatgpt_telegram_bot

★ 5,530

💬 Telegram bot with ChatGPT & Claude Python-based, using OpenAI's API.

Python

PurpleAILAB

Decepticon

★ 5,523

Autonomous Hacking Agent for Red Team

Python

ATH-MaaS

ComfyUI-Copilot

★ 5,516

An AI-powered custom node for ComfyUI designed to enhance workflow automation and provide intelligent assistance

TypeScript

Galaxy-Dawn

claude-scholar

★ 5,506

Semi-automated research assistant for academic research and software development. Supports Claude Code, Codex CLI, Kimi Code CLI, and OpenCode across ideation, coding, experiments, writing, and publication.

Python

Blaizzy

mlx-vlm

★ 5,500

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Python

BIT-DataLab

Edit-Banana

★ 5,481

Edit Banana: A framework for converting statistical formats into editable.

Python

larashero3-dotcom

lieflat-charts

★ 5,477

Data visualization Skill for AI Agents, turning data into polished, interactive HTML charts. 面向 AI Agents 的数据可视化 Skill，将数据快速生成精致、可交互的 HTML 图表。

HTML

brianpetro

obsidian-smart-connections

★ 5,452

Find related notes and excerpts while writing. Your link building copilot displays relevant content in graph + list view. A local embedding model powers semantic search. Zero setup. No API key.

JavaScript

junhoyeo

tokscale

★ 5,442

🛰️ Track token usage across AI coding agents from your terminal. 🏅 Global leaderboard with trillions of tokens tracked.

Rust

YILS-LIN

short-video-factory

★ 5,435

一键生成产品营销与泛内容短视频，AI批量自动剪辑，高颜值跨平台桌面端工具 One click generation of product marketing and general content short videos, AI batch automatic cliping, beautiful cross platform desktop tool

TypeScript

go-vikunja

vikunja

★ 5,406

The task manager you actually own.

0xeb

TheBigPromptLibrary

★ 5,403

A collection of prompts, system prompts and LLM instructions

HTML

nanbingxyz

5ire

★ 5,349

5ire is a cross-platform desktop AI assistant, MCP client. It compatible with major service providers, supports local knowledge base and tools via model context protocol servers .

TypeScript

PacktPublishing

LLM-Engineers-Handbook

★ 5,336

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

Python

metalbear-co

mirrord

★ 5,331

Run any process, on your machine or in an AI agent's environment, as if it were a pod in your Kubernetes cluster: real env vars, DNS, network, traffic.

Rust

maziyarpanahi

openmed

★ 5,325

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0.

Python