大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 193–216 個，共 866 個

cocoindex-io

cocoindex

★ 11,557

Incremental engine for long horizon agents 🌟 Star if you like it!

Rust

MemTensor

MemOS

★ 11,355

適用於 LLM 和 AI 代理程式的自我進化記憶體作業系統：超持久記憶體、混合檢索和跨任務技能重複使用，可節省 35.24% 的代幣。

TypeScript

holaboss-ai

Open-source agentic workspace enterprises can make their own. Connect the systems you already run — 100+ integrations, MCP, chat tools, apps, browser, local files — with shared memory. Any agent (Claude Code, Codex), any model, or BYOK. Set up in clicks, not months. Local-first: your data never leaves your machines.

TypeScript

microsoft

promptflow

★ 11,241

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Python

cobusgreyling

loop-engineering

★ 11,221

Practical patterns, starters & CLI tools for loop engineering with AI coding agents. Design systems that prompt and orchestrate agents (inspired by Addy Osmani and Boris Cherny). Includes loop-audit, loop-init, loop-cost.

TypeScript

datawhalechina

all-in-rag

★ 11,102

🔍大模型应用开发实战一：RAG 技术全栈指南，在线阅读地址：https://datawhalechina.github.io/all-in-rag/

Python

EKKOLearnAI

hermes-studio

★ 11,091

Web dashboard for Hermes Agent — multi-platform AI chat, session management, scheduled jobs, usage analytics

TypeScript

huggingface

chat-ui

★ 10,951

The open source codebase powering HuggingChat

TypeScript

langchain-ai

open-swe

★ 10,719

An Open-Source Asynchronous Coding Agent

Python

VoltAgent

voltagent

★ 10,624

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

TypeScript

RunanywhereAI

runanywhere-sdks

★ 10,283

Production ready toolkit to run AI locally

C++

astrid-runtime

astrid

★ 10,274

Astrid 是一個用於可組合軟體的便攜式、功能安全的作業系統。

Rust

Netflix

metaflow

★ 10,268

Build, Manage and Deploy AI/ML Systems

Python

chaitin

PandaWiki

★ 10,247

PandaWiki 是一款以AI大模型驅動的開源知識庫建立系統，可協助您快速建立客製化的產品文件、技術文件、FAQ、部落格系統，借助大模型的力量為您提供AI創作、AI問答、AI搜尋等能力。

TypeScript

omnigent-ai

omnigent

★ 9,937

Omnigent 是一個開源 AI 代理框架和元工具：編排 Claude Code、Codex、Cursor、Pi 和自訂代理，無需重寫即可交換工具，強制執行策略和沙箱，並透過任何裝置進行即時協作。

Python

Tiiny-AI

PowerInfer

★ 9,795

High-speed Large Language Model Serving for Local Deployment

C++

microsoft

UFO

★ 9,735

UFO³: Weaving the Digital Agent Galaxy

Python

mengxi-ream

read-frog

★ 9,685

🐸 Read Frog - Language Learning & Translate | 🐸 陪读蛙 - 语言学习与翻译

TypeScript

apache

seatunnel

★ 9,652

SeaTunnel是一個多模態、高效能、分散式、大量資料整合工具。

Java

adongwanai

AgentGuide

★ 9,631

MDX

FareedKhan-dev

train-llm-from-scratch

★ 9,622

A straightforward method for training your LLM, from downloading data to generating text.

Python

xorbitsai

inference

★ 9,566

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Python

Thysrael

Horizon

★ 9,360

您自己的人工智慧新聞雷達。產生英文和中文的每日簡報。 |人工智慧。

Python

thesysdev

openui

★ 9,335

The Open Standard for Generative UI

TypeScript