大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 289–312 個，共 866 個

Helicone

helicone

★ 6,158

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

TypeScript

UfoMiao

zcf

★ 6,084

Zero-Config Code Flow for Claude code & Codex

TypeScript

netease-youdao

Open-source, desktop-grade AI agent that gets real work done — data analysis, slides, docs, video & web research. Built on OpenClaw; runs tools on your real desktop and takes commands from your phone via WeChat, Feishu, DingTalk & Telegram.

TypeScript

om-ai-lab

VLM-R1

★ 6,024

Solve Visual Understanding with Reinforced VLMs

Python

cactus-compute

cactus

★ 6,017

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

C++

denizsafak

abogen

★ 6,006

Generate audiobooks from EPUBs, PDFs and text with synchronized captions.

Python

gluonfield

enchanted

★ 5,999

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Swift

FlorianBruniaux

claude-code-ultimate-guide

★ 5,976

The most comprehensive Claude Code guide: agentic workflows, hooks, skills, MCP servers, quizzes, and production-ready templates. 430K+ lines.

Python

Mai-with-u

MaiBot

★ 5,960

MaiSaka, an LLM-based intelligent agent, is a digital lifeform devoted to understanding you and interacting in the style of a real human. She does not pursue perfection, nor does she seek efficiency; instead, she values warmth, authenticity, and genuine connection.

Python

fengshao1227

ccg-workflow

★ 5,889

多模型协作工作流引擎 — /ccg:go 一个命令，AI 自动分析意图、选择策略、编排 Codex + Gemini + Claude 协作执行

pbek

QOwnNotes

★ 5,876

QOwnNotes is a plain-text file notepad and todo-list manager with Markdown support and Nextcloud / ownCloud integration.

C++

amazon-science

chronos-forecasting

★ 5,863

Chronos: Pretrained Models for Time Series Forecasting

Python

ModelEngine-Group

nexent

★ 5,863

Nexent 是一個零程式碼平台，用於使用 Harness Engineering 原理、統一工具、技能、記憶體和編排以及內建約束、反饋循環和控制平面來自動生成生產級 AI 代理程式。

Python

vllm-project

semantic-router

★ 5,826

A programmable Mixture-of-Models router for heterogeneous LLM inference

AgentOps-AI

agentops

★ 5,819

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Python

Giskard-AI

giskard-oss

★ 5,815

🐢 Open-Source Evaluation & Testing library for LLM Agents

Python

shibing624

MedicalGPT

★ 5,809

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

Python

Klavis-AI

klavis

★ 5,803

此專案圍繞「Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale.」建置，聚焦實際場景的開源實作，提供可重用的工具鏈與整合方式。

Python

PySpur-Dev

pyspur

★ 5,786

A visual playground for agentic workflows: Iterate over your agents 10x faster

TypeScript

areal-project

AReaL

★ 5,762

The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.

Python

generalaction

emdash

★ 5,748

Emdash is the Open-Source Agentic Development Environment (🧡 YC W26). Run multiple coding agents in parallel. Use any provider.

TypeScript

lemonade-sdk

lemonade

★ 5,721

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++

OpenBMB

UltraRAG

★ 5,694

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python

gpustack

★ 5,692

用於高效能 AI 模型服務（vLLM、SGLang）和按需可透過 SSH 存取的 GPU 執行個體的 GPU 叢集管理器。

Python