AI 频道
大模型应用

开源大模型应用与框架

这是范围最广的一组:聊天界面、SDK 和框架、提示词与评测工具,以及各种基于大语言模型的应用。很多项目可以接入多家服务商的模型,有些还能在你自己的硬件上运行模型。

怎么选

打算用在产品里的话,先确认三件事:许可证——有些热门项目限制商用;是否支持你正在用的模型服务商;以及它是否还在维护。每个项目页上的「秒懂」卡片会根据 GitHub 数据回答许可证和维护这两个问题。

Star 最多的项目

第 745–768 个,共 864 个
Jwuthri

Tracely-ai

1,403

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

Python
1,400

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

TypeScript
callstackincubator

ai

1,398

On-device LLM execution in React Native with Vercel AI SDK compatibility

TypeScript
explosion

spacy-llm

1,394

🦙 Integrating LLMs into structured NLP pipelines

Python
designcomputer

mysql_mcp_server

1,391

A Model Context Protocol (MCP) server that enables secure interaction with MySQL databases

Python
karust

openserp

1,391

Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉

Go
ovg-project

kvcached

1,391

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python
1,385

Application implementation with business use cases for safely utilizing generative AI in business operations

TypeScript
1,380

Unified KV Cache Compression Methods for Auto-Regressive Models

Python
1,377

Autonomous Agents (LLMs) research papers. Updated Daily.

GradientHQ

parallax

1,376

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python
AutoArk

TinyEngram

1,374

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Python
ServiceNow

BrowserGym

1,366

🌎💪 BrowserGym, a Gym environment for web task automation

Python
mohitagw15856

pm-claude-skills

1,364

Claude、ChatGPT、Gemini、Cursor 和 Codex 的 822 项专业代理技能,解码租约、编写 PRD、运行年度股东大会、准备 D&D 会议、练习薪资谈判。 Plain-markdown,MIT,在 Anthropic 的官方插件目录中。尝试免费的浏览器内或“npx pm-claude-skills add”。

HTML
morettt

my-neuro

1,364

This project lets you create your own AI desktop companion with customizable characters and voice conversations that respond in just 1 second. Features include long-term memory, visual recognition, voice cloning and LLM training. Compatible with various Live2D customizations.

JavaScript
ThousandBirdsInc

chidori

1,364

The agent framework where every run is durable, replayable, and resumable by default.

Rust
wrtnlabs

autobe

1,360

AI Vibe Coding Agent of TS backend server, enhanced by compiler skills, generating 100% working code

TypeScript
Dataojitori

nocturne_memory

1,357

A lightweight, rollbackable, and visual Long-Term Memory Server for MCP Agents. Say goodbye to Vector RAG and amnesia. Empower your AI with persistent, graph-like structured memory across any model, session, or tool. Drop-in replacement for OpenClaw.

Python
Abraxas-365

langchain-rust

1,344

🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust

Rust
alibaba

rtp-llm

1,340

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Python
ChaokunHong

MetaScreener

1,333

AI-powered tool for efficient abstract and PDF screening in systematic reviews.

Python
ddalcu

mlx-serve

1,333

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

Zig
RefoundAI

lenny-skills

1,331

86 product management skills from Lenny's Podcast for Claude Code and AI agents. Hiring, user research, strategy, shipping, and more.