AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,753–1,776 of 3,650
pireel

pireel

1,207

The open-source alternative to Capcut、ChatCut. Drivable by any AI agent over MCP.

TypeScript
2akouwu

reverify

1,205

Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is the proving ground. MCP server + CLI.

Python
heymrun

heym

1,205

Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.

Python

AI Agent Skill to generate and render beautiful Mermaid diagrams as SVG or terminal ASCII — 15 themes, 6 diagram types, batch CLI, no browser.

JavaScript
basetenlabs

truss

1,203

The simplest way to serve AI/ML models in production

Python
heyhuynhgiabuu

proxypal

1,203

A desktop app that lets you use your AI subscriptions (Claude, ChatGPT, Gemini, GitHub Copilot) with any coding tool. Wraps CLIProxyAPI with a clean UI for managing connections and tracking usage.

TypeScript
EvolvingLMMs-Lab

LLaVA-OneVision-2

1,202

Fully Open Framework for Democratized Multimodal Training

Python
xianyu110

gpt-codex

1,202

这是一个关于 OpenAI CodeX 的完整教程网站,专为国内开发者打造。

HTML
brainlid

langchain

1,201

Elixir implementation of a LangChain style framework that lets Elixir projects integrate with and leverage LLMs.

Elixir
CreminiAI

skillpack

1,201

Pack and deploy local AI agents for your team in minutes

TypeScript
ngxson

wllama

1,201

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

TypeScript
GanyuanRan

Aegis

1,200

Make AI coding agents architecture-aware: baseline-first, evidence-verified, drift-checked, and safe across long tasks.

Python
superlinear-ai

raglite

1,200

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Python
cvs-health

uqlm

1,199

[JMLR 2026] "UQLM: A Python Package for Uncertainty Quantification in Large Language Models"

Python
FranciscoMoretti

chat-js

1,199

Production-ready AI chat. Start here and make it your own. Formerly Sparka AI

TypeScript
letta-ai

agent-file

1,199

Agent File (.af): An open file format for serializing stateful AI agents with persistent memory and behavior. Share, checkpoint, and version control agents across compatible frameworks.

TypeScript
OpenPetsHQ

openpets

1,199

Local first, desktop companion platform with animated pets, plugin SDK and coding-agent integrations.

TypeScript
openvinotoolkit

nncf

1,199

Neural Network Compression Framework for enhanced OpenVINO™ inference

Python
langchain-ai

openevals

1,197

Readymade evaluators for your LLM apps

Python
sgl-project

sglang-omni

1,197

SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.

Python
RhythmicWave

NovelForge

1,196

AI辅助长篇小说创作,卡片式创作,支持基于 JSON Schema的结构化 AI 生成与上下文引用,可扩展性强。

Python
polterguy

magic

1,193

Instant SECURE Full Stack Apps and AI Agents

C#
clacky-ai

openclacky

1,192

The most Token-efficient open-source AI Agent

Ruby