大模型应用

开源大模型应用与框架

这是范围最广的一组：聊天界面、SDK 和框架、提示词与评测工具，以及各种基于大语言模型的应用。很多项目可以接入多家服务商的模型，有些还能在你自己的硬件上运行模型。

怎么选

打算用在产品里的话，先确认三件事：许可证——有些热门项目限制商用；是否支持你正在用的模型服务商；以及它是否还在维护。每个项目页上的「秒懂」卡片会根据 GitHub 数据回答许可证和维护这两个问题。

Star 最多的项目

第 817–840 个，共 864 个

RhythmicWave

NovelForge

★ 1,196

AI辅助长篇小说创作，卡片式创作，支持基于 JSON Schema的结构化 AI 生成与上下文引用，可扩展性强。

Python

polterguy

magic

★ 1,193

Instant SECURE Full Stack Apps and AI Agents

NVIDIA-NeMo

Gym

★ 1,189

Evaluate and improve models and agents using environments

Python

madox2

vim-ai

★ 1,188

AI-powered code assistant for Vim. OpenAI and ChatGPT plugin for Vim and Neovim.

Python

FunnyWolf

agentic-soc-platform

★ 1,181

Agentic SOC Platform: A powerful, flexible, open-source, and agent-centric automated security operations platform (AI SOC)

Python

rudrankriyam

Foundation-Models-Framework-Lab

★ 1,181

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

Swift

sgl-project

SpecForge

★ 1,176

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Python

bodaay

HuggingFaceModelDownloader

★ 1,172

Simple go utility to download HuggingFace Models and Datasets

ENTERPILOT

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

AI-QL

tuui

★ 1,154

A desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.

TypeScript

zjunlp

LightMem

★ 1,149

[ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation

Python

Rath-Team

OpenRath

★ 1,136

An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.

Python

xuzhougeng

wisp-science

★ 1,136

开源、本地优先的桌面 AI 研究工作台，用于使用 Python/R、MCP 生物信息学工具、SSH/WSL/GPU 运行时和 OpenAI/Anthropic 模型进行科学计算。

HTML

codelibs

fess

★ 1,135

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.

Java

massgen

MassGen

★ 1,130

🚀 MassGen is an open-source multi-agent scaling system that runs in your terminal, autonomously orchestrating frontier models and agents to collaborate, reason, and produce high-quality results. | Join us on Discord: discord.massgen.ai

Python

NovaSearch-Team

RAG-Retrieval

★ 1,130

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

Python

withkynam

vibecode-pro-max-kit

★ 1,130

Your AI forgets. This remembers. Spec-driven coding harness for vibecoders, product owners, CEOs and real builders — self-improving context memory, 15 agents, 33 skills working with /goal, agent-team, & workflow on autopilot loops with 0 need for human gate. Kills context rot, ships features, not spaghetti. Claude Code & Codex. Any stack

JavaScript

mrwadams

stride-gpt

★ 1,123

An AI-powered threat modeling tool that leverages OpenAI's GPT models to generate threat models for a given application based on the STRIDE methodology.

Python