大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 217–240 個，共 866 個

activeloopai

deeplake

★ 9,235

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

C++

BoundaryML

baml

★ 9,180

The programming language for agents

Rust

shaxiu

XianyuAutoAgent

★ 9,173

智能闲鱼客服机器人系统：专为闲鱼平台打造的AI值守解决方案，实现闲鱼平台7×24小时自动化值守，支持多专家协同决策、智能议价和上下文感知对话。

Python

iflytek

astron-agent

★ 9,016

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

Java

bentoml

BentoML

★ 8,842

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Python

fishaudio

Bert-VITS2

★ 8,800

vits2 backbone with multilingual-bert

Python

google

adk-go

★ 8,793

An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

microsoft

TypeChat

★ 8,685

TypeChat is a library that makes it easy to build natural language interfaces using types.

TypeScript

0xPlaygrounds

rig

★ 8,640

⚙️🦀 Build modular and scalable LLM Applications in Rust

Rust

poloclub

transformer-explainer

★ 8,580

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

JavaScript

bitsandbytes-foundation

bitsandbytes

★ 8,478

Accessible large language models via k-bit quantization for PyTorch.

Python

idosal

git-mcp

★ 8,393

Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project

TypeScript

qualcomm

GenieX

★ 8,373

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Rust

deeplethe

utopia

★ 8,370

World's first open-source enterprise world model.

Rust

maximhq

bifrost

★ 8,090

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

InternLM

lmdeploy

★ 8,071

此專案圍繞「InternLM/lmdeploy」建置，面向真實業務場景，提供可重複使用、可持續維運的開源實作。

Python

trailhq

Graft

★ 8,014

Turbocharge Claude Code, Cursor, Codex, Gemini & every coding agent: faster, cheaper, with contextual understanding specific to your codebase.

TypeScript

FareedKhan-dev

kimi-k3-in-c

★ 7,952

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

evidentlyai

evidently

★ 7,917

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Jupyter Notebook