AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,777–1,800 of 4,627
★ 1,835

A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team in the Language Technology Lab, Tongyi Lab, Alibaba Group.

C++
tile-ai

TileRT

★ 1,831

Tile-Based Runtime for Ultra-Low-Latency LLM Inference

Python
OpenAgentPlatform

Dive

★ 1,829

Dive is an open-source MCP Host Desktop Application that seamlessly integrates with any LLMs supporting function calling capabilities. ✨

TypeScript
benchflow-ai

skillsbench

★ 1,827

SkillsBench evaluates how well skills work and how effective agents are at using them.

PDDL
AminForou

mcp-gsc

★ 1,826

Google Search Console Insights with Claude AI for SEOs

Python
★ 1,825

仕事の日本語を、読みやすくわかりやすく書く・直すための Agent Skill です。

Python
Pythagora-io

pythagora

★ 1,824

Generate automated tests for your Node.js app via LLMs without developers having to write a single line of code.

JavaScript
trpc-group

trpc-agent-go

★ 1,823

A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

Go
★ 1,822

Babysitter enforces obedience on agentic workforces and enables them to manage extremely complex tasks and workflows through deterministic, hallucination-free self-orchestration

JavaScript
potamides

DeTikZify

★ 1,820

Synthesizing Graphics Programs for Scientific Figures and Sketches with TikZ.

Python
trymirai

uzu

★ 1,820

A high-performance inference engine for AI models

Rust
APIParkLab

APIPark

★ 1,819

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关，LLM API 管理、分发系统、开放平台，支持所有AI API，不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 请求和返回，API申请与审批，调用统计、负载均衡、多模型灾备。一键部署，开箱即用。

TypeScript
generative-computing

mellea

★ 1,819

Mellea is a library for writing generative programs.

Python
Core-Mate

OpenGUI

★ 1,813

OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.

TypeScript
sybil-solutions

local-studio

★ 1,813

Control panel for VLLM, Sglang, llama.cpp, exllamav3

TypeScript
★ 1,810

Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state), ~114 tok/s single-user at default sampling / ~124 greedy (MTP drafts, own-output draft vocab, calibrated int4 lm_head, split-KV verify attention), 150k-262k context; patches, requant scripts, benchmarks

Python
zi-yue-1129

DATAGEN

★ 1,810

DATAGEN: AI-driven multi-agent research assistant automating hypothesis generation, data analysis, and report writing.

Python
Darkatse

TauriTavern

★ 1,809

The classic Sillytavern, now has been rewritten in Tauri/Rust.

JavaScript
stakpak

agent

★ 1,807

Ship your code, on autopilot. An open source agent that lives on your machines 24/7 and keeps your apps running. 🦀

Rust
Trusted-AI

AIX360

★ 1,807

Interpretability and explainability of data and machine learning models

Python
undertheseanlp

underthesea

★ 1,807

Underthesea - AI Assistant

Python
open-mercato

open-mercato

★ 1,803

The AI-Engineering Foundation Framework for CRM/ERP and commerce: open-source TypeScript, with multi-tenancy, RBAC, events and domain modules already decided as conventions and specs, so Cursor, Claude Code and Codex build features instead of re-deciding architecture. Start with 80% done.

TypeScript
Mcp-Brasil

mcp-brasil

★ 1,801

MCP Server para 70 APIs públicas brasileiras

Python