AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

433–456 of 3,650
open-multi-agent

open-multi-agent

6,922

TypeScript AI agent orchestration framework with dynamic workflows. Describe the goal, not the graph: a coordinator plans the task DAG at runtime and runs it on any LLM (Claude, ChatGPT, Gemini, DeepSeek, or local models).

TypeScript
Gentleman-Programming

gentle-ai

6,888

Gentle-AI configures the AI coding agents you already use: Claude Code, Cursor, OpenCode, Codex, Pi, and more. Choose persistent memory, Spec-Driven Development, curated skills, MCP servers, personas, and optional bounded review. Open source, no agent lock-in.

Go
6,826

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Python
dataease

SQLBot

6,812

🔥 基于大模型和 RAG 的智能问数系统,对话式数据分析神器。Text-to-SQL Generation via LLMs using RAG.

JavaScript
6,812

PC 端语音输入工具,离线识别,高准确率、低延迟,支持热词、LLM润色。按住CapsLock或鼠标侧键X2说话,松开自动上屏。

Python
anbeime

skill

6,809

收录最全、更新最快的技能Skills商店:精选原创技能包(涵盖文档处理、内容创作、编程开发、机器学习、自动化工作流),全部打包好可直接安装使用!同时自动抓取GitHub上万个Skills项目,按分类、更新时间、Star数量整理。The most comprehensive and frequently updated AI Agent skill library, featuring curated skill packs across document processing, content creation, programming, machine learning, automated workflows, and many more domains.

Python
6,801

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

Go
purocean

yn

6,755

A highly extensible Markdown editor. Version control, AI Copilot, mind map, documents encryption, code snippet running, integrated terminal, chart embedding, HTML applets, Reveal.js, plug-in, and macro replacement.

TypeScript
superagent-ai

superagent

6,748

Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.

TypeScript
6,746

《大模型与智能体》电子书与 6 个编程任务:Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。

Python
6,737

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Swift
mobile-next

mobile-mcp

6,706

Model Context Protocol Server for Mobile Automation and Scraping (iOS, Android, Emulators, Simulators and Real Devices)

TypeScript
6,699

Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories

TypeScript
pig-mesh

pig

6,685

↥ ↥ ↥ Follow for updates An RBAC permission management system based on Spring Cloud 2025, Spring Boot 4, and OAuth2.

Java
MakazhanAlpamys

Soup

6,674

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Python
6,667

🦋 An Infographic Generation and Rendering Framework, bring words to life with AI!

TypeScript
microsoft

LLMLingua

6,664

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Python
Andyyyy64

whichllm

6,640

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

Python
linkedin

Liger-Kernel

6,614

Efficient Triton Kernels for LLM Training

Python
BlockRunAI

ClawRouter

6,603

The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.

TypeScript
liliMozi

openhanako

6,588

A personal AI agent with memory, personality, and autonomy.

TypeScript
julep-ai

julep

6,585

Julep, durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Python
kvcache-ai

Mooncake

6,578

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

C++