大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 793–816 個，共 866 個

kubeai-project

kubeai

★ 1,263

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

ihor-sokoliuk

mcp-searxng

★ 1,242

Private web search for AI assistants via SearXNG — supports Claude, Cursor, and any MCP client

TypeScript

mrwadams

AttackGen is a cybersecurity incident response testing tool that leverages the power of large language models and the comprehensive MITRE ATT&CK framework. The tool generates tailored incident response scenarios based on user-selected threat actor groups and your organisation's details.

Python

ipa-lab

hackingBuddyGPT

★ 1,239

Helping Ethical Hackers use LLMs in 50 Lines of Code or less..

Python

sums001

Windows-Copilot-API

★ 1,239

Reverse engineered Windows Copilot into an OpenAI-compatible API. Access GPT-4 and GPT-5 models through a simple REST interface without API keys or billing.

Python

proxysoul

Empryo

★ 1,237

Empryo issue tracker + SoulForge (v2). Empryo is the graph-powered AI coding agent that edits symbols, not strings: AST surgery, full LSP, a live code genome. Get it at https://empryo.com

TypeScript

TIGER-AI-Lab

OpenResearcher

★ 1,235

OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesis

Python

Runfusion

Fusion

★ 1,228

您的軟體工廠 - 使用 24/7 工作的多節點代理更快更好地建置。

TypeScript

InternScience

GraphGen

★ 1,222

GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation

Python

jieyefriic

rp-engine

★ 1,222

YAML-native agent workflow execution engine, written in Rust

Rust

thClaws

★ 1,222

透過一個二進位檔案在本機 Rust、GUI、CLI、headless 和 webapp 中利用開源 AI 代理程式。多提供者、MCP、技能、插件、代理商團隊。

Rust

hexabot-ai

Hexabot

★ 1,221

Hexabot v3 is an AI workflow automation platform, combining workflows, actions, agents, and conversational channels in one runtime.

TypeScript

wanxingai

LightAgent

★ 1,219

LightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and workflows.

Python

datawhalechina

torch-rechub

★ 1,217

A Lighting Pytorch Framework for Recommendation Models, Easy-to-use and Easy-to-extend.

Jupyter Notebook

moltlaunch

cashclaw

★ 1,215

An autonomous agent that takes work, does work, gets paid, and gets better at it.

TypeScript

ZHangZHengEric

Sage

★ 1,215

Multi-Agent System Framework For Complex Tasks

Python

SaladDay

pi-from-scratch

★ 1,212

600 行 TypeScript 写成的超级迷你版 pi，让你轻松从 0 写出属于你的 pi-agent

TypeScript

NVIDIA

kvpress

★ 1,208

LLM KV cache compression made easy

Python

2akouwu

reverify

★ 1,205

Stop your AI from making things up — it proposes, deterministic tools decide, every claim checked against ground truth with evidence. Grounded facts and context survive resets. Reverse engineering is the proving ground. MCP server + CLI.

Python