大模型应用

开源大模型应用与框架

这是范围最广的一组：聊天界面、SDK 和框架、提示词与评测工具，以及各种基于大语言模型的应用。很多项目可以接入多家服务商的模型，有些还能在你自己的硬件上运行模型。

怎么选

打算用在产品里的话，先确认三件事：许可证——有些热门项目限制商用；是否支持你正在用的模型服务商；以及它是否还在维护。每个项目页上的「秒懂」卡片会根据 GitHub 数据回答许可证和维护这两个问题。

Star 最多的项目

第 265–288 个，共 864 个

adbar

trafilatura

★ 6,821

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Python

dataease

SQLBot

★ 6,801

🔥 基于大模型和 RAG 的智能问数系统，对话式数据分析神器。Text-to-SQL Generation via LLMs using RAG.

JavaScript

tbphp

gpt-load

★ 6,775

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关：多渠道多凭据统一接入，含密钥与订阅账号、调度容错、日志与用量。

nndl

llm-beginner

★ 6,746

《大模型与智能体》电子书与 6 个编程任务：Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。

Python

drumih

turbo-fieldfare

★ 6,737

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Swift

vas3k

TaxHacker

★ 6,699

Self-hosted AI accounting app. LLM analyzer for receipts, invoices, transactions with custom prompts and categories

TypeScript

antvis

Infographic

★ 6,667

🦋 An Infographic Generation and Rendering Framework, bring words to life with AI!

TypeScript

BlockRunAI

ClawRouter

★ 6,603

The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.

TypeScript

MakazhanAlpamys

Soup

★ 6,596

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Python

julep-ai

julep

★ 6,587

Julep，耐用、可组合的 AI 代理。崩溃和恢复、安全重试并解释每一步的流程。

Python

kvcache-ai

Mooncake

★ 6,578

Mooncake是Moonshot AI提供的领先的LLM服务Kimi的服务平台。

C++

j3ssie

osmedeus

★ 6,566

A Modern Orchestration Engine for Security

airweave-ai

airweave

★ 6,565

AI 代理的开源上下文检索层。用于 AI 代理和 RAG 系统的开源上下文检索层。

Python

Osmantic

ODS

★ 6,488

将您的 PC、Mac 或 Linux 机器变成 AI 服务器。 LLM 推理、聊天 UI、语音、代理、工作流程、RAG 和图像生成。

Python

josStorer

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

TypeScript

genkit-ai

genkit

★ 6,441

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

TypeScript

haifengl

smile

★ 6,414

Statistical Machine Intelligence & Learning Engine

Java

Arthur-Ficial

apfel

★ 6,384

The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.

Swift