大模型应用

开源大模型应用与框架

这是范围最广的一组：聊天界面、SDK 和框架、提示词与评测工具，以及各种基于大语言模型的应用。很多项目可以接入多家服务商的模型，有些还能在你自己的硬件上运行模型。

怎么选

打算用在产品里的话，先确认三件事：许可证——有些热门项目限制商用；是否支持你正在用的模型服务商；以及它是否还在维护。每个项目页上的「秒懂」卡片会根据 GitHub 数据回答许可证和维护这两个问题。

Star 最多的项目

第 193–216 个，共 864 个

MemTensor

MemOS

★ 11,355

适用于 LLM 和 AI 代理的自我进化内存操作系统：超持久内存、混合检索和跨任务技能重用，可节省 35.24% 的代币。

TypeScript

holaboss-ai

Open-source agentic workspace enterprises can make their own. Connect the systems you already run — 100+ integrations, MCP, chat tools, apps, browser, local files — with shared memory. Any agent (Claude Code, Codex), any model, or BYOK. Set up in clicks, not months. Local-first: your data never leaves your machines.

TypeScript

microsoft

promptflow

★ 11,241

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Python

cobusgreyling

loop-engineering

★ 11,221

Practical patterns, starters & CLI tools for loop engineering with AI coding agents. Design systems that prompt and orchestrate agents (inspired by Addy Osmani and Boris Cherny). Includes loop-audit, loop-init, loop-cost.

TypeScript

datawhalechina

all-in-rag

★ 11,102

🔍大模型应用开发实战一：RAG 技术全栈指南，在线阅读地址：https://datawhalechina.github.io/all-in-rag/

Python

EKKOLearnAI

hermes-studio

★ 11,091

Web dashboard for Hermes Agent — multi-platform AI chat, session management, scheduled jobs, usage analytics

TypeScript

huggingface

chat-ui

★ 10,951

The open source codebase powering HuggingChat

TypeScript

langchain-ai

open-swe

★ 10,719

An Open-Source Asynchronous Coding Agent

Python

VoltAgent

voltagent

★ 10,624

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

TypeScript

RunanywhereAI

runanywhere-sdks

★ 10,283

Production ready toolkit to run AI locally

C++

astrid-runtime

astrid

★ 10,274

Astrid 是一个用于可组合软件的便携式、功能安全的操作系统。

Rust

Netflix

metaflow

★ 10,268

Build, Manage and Deploy AI/ML Systems

Python

chaitin

PandaWiki

★ 10,247

PandaWiki 是一款AI大模型驱动的开源知识库搭建系统，帮助您快速构建定制化的产品文档、技术文档、FAQ、博客系统，借助大模型的力量为您提供AI创作、AI问答、AI搜索等能力。

TypeScript

omnigent-ai

omnigent

★ 9,937

Omnigent 是一个开源 AI 代理框架和元工具：编排 Claude Code、Codex、Cursor、Pi 和自定义代理，无需重写即可交换工具，强制执行策略和沙箱，并通过任何设备进行实时协作。

Python

Tiiny-AI

PowerInfer

★ 9,795

High-speed Large Language Model Serving for Local Deployment

C++

microsoft

UFO

★ 9,735

UFO³: Weaving the Digital Agent Galaxy

Python

mengxi-ream

read-frog

★ 9,685

🐸 Read Frog - Language Learning & Translate | 🐸 陪读蛙 - 语言学习与翻译

TypeScript

apache

seatunnel

★ 9,652

SeaTunnel是一个多模态、高性能、分布式、海量数据集成工具。

Java

adongwanai

AgentGuide

★ 9,631

MDX

FareedKhan-dev

train-llm-from-scratch

★ 9,622

A straightforward method for training your LLM, from downloading data to generating text.

Python

xorbitsai

inference

★ 9,566

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Python