AI 頻道
大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組:聊天介面、SDK 與框架、提示詞與評測工具,以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型,有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話,先確認三件事:授權——有些熱門專案限制商用;是否支援你正在用的模型服務商;以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 361–384 個,共 866 個
JetBrains

koog

4,572

Koog is a JVM (Java and Kotlin) framework for building predictable, fault-tolerant and enterprise-ready AI agents across all platforms – from backend services to Android and iOS, JVM, and even in-browser environments. Koog is based on our AI products expertise and provides proven solutions for complex LLM and AI problems

Kotlin
4,567

learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

Python
llm-d

llm-d

4,562

Achieve state of the art inference performance with modern accelerators on Kubernetes

Shell
VectifyAI

OpenKB

4,522

OpenKB: Open LLM Knowledge Base

Python
4,507

35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, BrowserAgent, ...) — a Python library and runnable textbook with multi-provider LLM support and a 17-task benchmark leaderboard.

Jupyter Notebook
FlowElement-xinliuyuansu

m_flow

4,501

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

Python
CaviraOSS

LongMemory

4,499

Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.

TypeScript
microsoft

LMOps

4,472

General technology for enabling AI capabilities w/ LLMs and MLLMs

Python
daveebbelaar

ai-cookbook

4,461

Examples and tutorials to help developers build AI systems

Python
mosaicml

llm-foundry

4,445

LLM training code for Databricks foundation models

Python
4,430

CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.

Python
conorbronsdon

avoid-ai-writing

4,416

Skill that audits and rewrites content to remove AI writing patterns. Use it with your favorite agents including Claude Code, OpenClaw, Codex, and Hermes.

JavaScript
gptme

gptme

4,415

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

Python
open-compass

VLMEvalKit

4,394

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Python
cs-lazy-tools

ChatGPT-On-CS

4,392

拼多多、千牛、抖店 AI 客服机器人:自动回复客户咨询、商品答疑、售后申诉处理,支持微信、小红书、京东、抖音、B站、微博等多平台统一接待;可接入 DeepSeek / 通义千问 等大模型,支持自有知识库定制。

TypeScript
4,391

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

Python
4,376

One delightful Ruby framework for every major AI provider. Build AI agents, chatbots, RAG apps, and multimodal workflows in beautiful, expressive code.

Ruby
4,365

🤖 A visualization mcp & skills contains 25+ visual charts using @antvis. Using for chart generation and data analysis.

TypeScript
datawhalechina

llms-from-scratch-cn

4,364

仅需Python基础,从0构建大语言模型;从0逐步构建GLM4\Llama3\RWKV6, 深入理解大模型原理

Jupyter Notebook
SenteLabsAI

OpenExecutive

4,320

AI-powered virtual executive team — a single coherent executive persona backed by 8 specialist agents (FastAPI + Next.js).

Python
ModelTC

LightLLM

4,290

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Python
IvanMurzak

Unity-MCP

4,278

AI Skills, MCP Tools, and CLI for Unity Engine. Full AI develop and test loop. Use cli for quick setup. Efficient token usage, advanced tools. Any C# method may be turned into a tool by a single line. Works with Claude Code, Gemini, Copilot, Cursor and any other absolutely for free.

C#
StructuredLabs

preswald

4,270

Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable completely in-browser, using Pyodide, DuckDB, Pandas, and Plotly, Matplotlib, etc. Build dashboards, reports, and notebooks that run offline, load fast, and share like a document.

Python
deepflowio

deepflow

4,267

eBPF Observability - Distributed Tracing and Profiling

Go