大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 817–840 個，共 866 個

FranciscoMoretti

chat-js

★ 1,199

Production-ready AI chat. Start here and make it your own. Formerly Sparka AI

TypeScript

openvinotoolkit

nncf

★ 1,199

Neural Network Compression Framework for enhanced OpenVINO™ inference

Python

RhythmicWave

NovelForge

★ 1,196

AI辅助长篇小说创作，卡片式创作，支持基于 JSON Schema的结构化 AI 生成与上下文引用，可扩展性强。

Python

polterguy

magic

★ 1,193

Instant SECURE Full Stack Apps and AI Agents

NVIDIA-NeMo

Gym

★ 1,189

Evaluate and improve models and agents using environments

Python

madox2

vim-ai

★ 1,188

AI-powered code assistant for Vim. OpenAI and ChatGPT plugin for Vim and Neovim.

Python

FunnyWolf

agentic-soc-platform

★ 1,181

Agentic SOC Platform: A powerful, flexible, open-source, and agent-centric automated security operations platform (AI SOC)

Python

rudrankriyam

Foundation-Models-Framework-Lab

★ 1,181

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

Swift

sgl-project

SpecForge

★ 1,176

Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

Python

bodaay

HuggingFaceModelDownloader

★ 1,172

Simple go utility to download HuggingFace Models and Datasets

ENTERPILOT

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

AI-QL

tuui

★ 1,154

A desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.

TypeScript

zjunlp

LightMem

★ 1,149

[ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation

Python

Rath-Team

OpenRath

★ 1,136

An open-source, PyTorch-like runtime for dynamic multi-agent and multi-session workflows.

Python

xuzhougeng

wisp-science

★ 1,136

開源、本地優先的桌面 AI 研究工作台，用於使用 Python/R、MCP 生物資訊工具、SSH/WSL/GPU 運行時和 OpenAI/Anthropic 模型進行科學計算。

HTML

codelibs

fess

★ 1,135

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.

Java

massgen

MassGen

★ 1,130

🚀 MassGen is an open-source multi-agent scaling system that runs in your terminal, autonomously orchestrating frontier models and agents to collaborate, reason, and produce high-quality results. | Join us on Discord: discord.massgen.ai

Python

NovaSearch-Team

RAG-Retrieval

★ 1,130

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

Python

withkynam

vibecode-pro-max-kit

★ 1,130

Your AI forgets. This remembers. Spec-driven coding harness for vibecoders, product owners, CEOs and real builders — self-improving context memory, 15 agents, 33 skills working with /goal, agent-team, & workflow on autopilot loops with 0 need for human gate. Kills context rot, ships features, not spaghetti. Claude Code & Codex. Any stack

JavaScript

mrwadams

stride-gpt

★ 1,123

An AI-powered threat modeling tool that leverages OpenAI's GPT models to generate threat models for a given application based on the STRIDE methodology.

Python