大模型应用

开源大模型应用与框架

这是范围最广的一组：聊天界面、SDK 和框架、提示词与评测工具，以及各种基于大语言模型的应用。很多项目可以接入多家服务商的模型，有些还能在你自己的硬件上运行模型。

怎么选

打算用在产品里的话，先确认三件事：许可证——有些热门项目限制商用；是否支持你正在用的模型服务商；以及它是否还在维护。每个项目页上的「秒懂」卡片会根据 GitHub 数据回答许可证和维护这两个问题。

Star 最多的项目

第 217–240 个，共 864 个

BoundaryML

baml

★ 9,180

The programming language for agents

Rust

shaxiu

XianyuAutoAgent

★ 9,173

智能闲鱼客服机器人系统：专为闲鱼平台打造的AI值守解决方案，实现闲鱼平台7×24小时自动化值守，支持多专家协同决策、智能议价和上下文感知对话。

Python

iflytek

astron-agent

★ 9,016

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

Java

bentoml

BentoML

★ 8,842

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Python

fishaudio

Bert-VITS2

★ 8,800

vits2 backbone with multilingual-bert

Python

google

adk-go

★ 8,793

An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

microsoft

TypeChat

★ 8,685

TypeChat is a library that makes it easy to build natural language interfaces using types.

TypeScript

0xPlaygrounds

rig

★ 8,640

⚙️🦀 Build modular and scalable LLM Applications in Rust

Rust

poloclub

transformer-explainer

★ 8,580

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

JavaScript

bitsandbytes-foundation

bitsandbytes

★ 8,478

Accessible large language models via k-bit quantization for PyTorch.

Python

idosal

git-mcp

★ 8,393

Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project

TypeScript

qualcomm

GenieX

★ 8,373

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Rust

deeplethe

utopia

★ 8,370

World's first open-source enterprise world model.

Rust

maximhq

bifrost

★ 8,090

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

InternLM

lmdeploy

★ 8,071

该项目围绕「InternLM/lmdeploy」构建，面向真实业务场景提供可复用的开源实践方案，支持稳定落地与可扩展的项目实践。

Python

trailhq

Graft

★ 8,014

Turbocharge Claude Code, Cursor, Codex, Gemini & every coding agent: faster, cheaper, with contextual understanding specific to your codebase.

TypeScript

FareedKhan-dev

kimi-k3-in-c

★ 7,952

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

evidentlyai

evidently

★ 7,917

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Jupyter Notebook