AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

913–936 of 3,650
ianarawjo

ChainForge

3,029

An open-source visual programming environment for battle-testing prompts to LLMs.

TypeScript
3,028

A agent framework based on the tutorial hello-agents

Python
xyproto

algernon

3,028

Small self-contained pure-Go web server with Lua, Teal, Markdown, HTTP/2, QUIC, Redis, TypeScript, npm-less React 19, SQLite, and PostgreSQL support ++

JavaScript
betalgo

openai

3,023

.NET library for the OpenAI service API by Betalgo Ranul

C#

A practical Claude Code guide with clear mental models and copy-paste examples — setup, prompt engineering, slash commands, skills, hooks, subagents, agent teams, and MCP servers. Beginner path to power-user depth. Featured in Awesome Claude Code.

Python
3,014

Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。

JavaScript

A python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from various relevant websites and do research for you all on its own! And more, not limited to but including saving the findings for you!

Python
Simon-He95

markstream-vue

3,010

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.

Vue
3,009

J-Space Cognition Suite V3.7 - AI cognitive-enhancement Skills based on Anthropic's J-space global workspace research. | 哔哩哔哩:Tiger380 (UID 3494375382321675) — https://space.bilibili.com/3494375382321675

Python
3,008

Open-source AI agent for B2B lead generation — describe your product, it finds the people who fit, explains why each one does, and emails them from your mailbox. Self-hosted CLI, one install.

Python
Dicklesworthstone

llm_aided_ocr

3,000

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs

Python
thu-pacman

chitu

2,998

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

Python
eli64s

readme-ai

2,986

README file generator, powered by AI.

Python
vercel-labs

opensrc

2,983

Fetch source code for npm packages to give AI coding agents deeper context

Rust
signerless

llm-checker

2,970

Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.

JavaScript
milind-soni

OpenMausBot

2,968

Open Source Alternative to Grok Bot with a virtual machine that bots can use

TypeScript
AlephAITech

WorkBuddyGuide

2,960

A practical, open-source guide to mastering WorkBuddy through real-world workflows.开源的 WorkBuddy 实战蓝皮书:教程、真实工作流、Skills、MCP、自动化与多智能体实践。.

Python
supabase-community

database-build

2,954

In-browser Postgres sandbox with AI assistance (formerly postgres.new)

TypeScript
2,952

🎭 AI 写小说:从零生成 10-50 章完整中文小说,三层问答 · 创作记忆 · 悬念钩子 · 自动校验,长篇网文连载皆宜|开源免费,适配主流 coding agent|AI novel writing skill

Python
MacPaw

OpenAI

2,944

Swift community driven package for OpenAI public API

Swift
collabs-inc

collab-public

2,943

Collaborator is a place to create with agents.

TypeScript
michaelfeil

infinity

2,941

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Python
open-gitagent

opengap

2,941

A framework-agnostic, git-native standard for defining AI agents

TypeScript
yunionio

cloudpods

2,941

An open-source cloud-native unified-cloud platform. 开源云原生融合云平台

Go