AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

265–288 of 4,628
botpress

botpress

★ 14,929

The open-source hub to build & deploy GPT/LLM Agents ⚡️

TypeScript
★ 14,899

这是一款提高ChatGPT的数据安全能力和效率的插件。并且免费共享大量创新功能，如：自动刷新、保持活跃、数据安全、取消审计、克隆对话、言无不尽、净化页面、展示大屏、拦截跟踪、日新月异、明察秋毫等。让我们的AI体验无比安全、顺畅、丝滑、高效、简洁。

JavaScript
llmware-ai

llmware

★ 14,843

Unified framework for building enterprise RAG pipelines with small, specialized models

Python
★ 14,749

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Python
fish2018

pansou

★ 14,731

PanSou是一款高性能的网盘资源搜索API服务，支持TG频道和插件搜索。系统设计以性能和可扩展性为核心，支持多频道多插件并发搜索、结果智能排序和网盘类型分类。docker集成前后端，一键启动，开箱即用。仅供学习研究，请勿以各种形式用于盈利目的。 https://t.me/s/webhtv

Go
BlinkDL

RWKV-LM

★ 14,710

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Python
microsoft

RD-Agent

★ 14,657

Research and development (R&D) is crucial for the enhancement of industrial productivity, especially in the AI era, where the core aspects of R&D are mainly focused on data and models. We are committed to automating these high-value generic R&D processes through R&D-Agent, which lets AI drive data-driven AI. 🔗https://aka.ms/RD-Agent-Tech-Report

Python
superset-sh

superset

★ 14,636

Superset is an agentic IDE to orchestrate 100+ coding agents in parallel. Run any agent with your own subscription.

TypeScript
★ 14,607

An uroboros program with 100+ programming languages

Ruby
★ 14,512

基于 Playwright 和AI实现的闲鱼多任务实时/定时监控与智能分析系统，配备了功能完善的后台管理UI。帮助用户从闲鱼海量商品中，找到心仪产品。

Python
Datalux

Osintgram

★ 14,492

Osintgram is a OSINT tool on Instagram. It offers an interactive shell to perform analysis on Instagram account of any users by its nickname

Python
NevaMind-AI

memU

★ 14,487

Personal memory across agents

Python
casdoor

casdoor

★ 14,477

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

Go
★ 14,344

Desktop Companion for Hermes Agent. Use it in Hermes One by selecting Atlas Cloud as your provider.

TypeScript
waooAI

waoowaoo

★ 14,338

首家工业级全流程 AI 影视生产平台。Industry-first professional AI Agent platform for controllable film & video production. From shorts to live-action with Hollywood-standard workflows.

TypeScript
CoplayDev

unity-mcp

★ 14,295

Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.

C#
★ 14,269

match command-line arguments to their help text

Python
datawhalechina

llm-universe

★ 14,043

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

Jupyter Notebook
e2b-dev

E2B

★ 14,028

Open-source, secure environment with real-world tools for enterprise-grade agents.

Python
567-labs

instructor

★ 13,911

structured outputs for llms

Python
★ 13,889

Context engineering is the new vibe coding - it's the way to actually make AI coding assistants work. Claude Code is the best for this so that's what this repo is centered around, but you can apply this strategy with any AI coding assistant!

Python
★ 13,866

A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.

Python
nanobrowser

nanobrowser

★ 13,850

Open-Source Chrome extension for AI-powered web automation. Run multi-agent workflows using your own LLM API key. Alternative to OpenAI Operator.

TypeScript