大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 745–768 個，共 866 個

Houseofmvps

codesight

★ 1,405

Universal AI context generator. Saves thousands of tokens per conversation in Claude Code, Cursor, Copilot, Codex, and more.

TypeScript

awaescher

OllamaSharp

★ 1,404

The easiest way to use Ollama in .NET

Jwuthri

Tracely-ai

★ 1,403

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

Python

aws-samples

aws-genai-llm-chatbot

★ 1,400

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

TypeScript

callstackincubator

ai

★ 1,398

On-device LLM execution in React Native with Vercel AI SDK compatibility

TypeScript

explosion

spacy-llm

★ 1,394

🦙 Integrating LLMs into structured NLP pipelines

Python

designcomputer

mysql_mcp_server

★ 1,391

A Model Context Protocol (MCP) server that enables secure interaction with MySQL databases

Python

karust

openserp

★ 1,391

Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉

ovg-project

kvcached

★ 1,391

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

Python

OWASP

www-project-top-10-for-large-language-model-applications

★ 1,391

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

Python

aws-samples

generative-ai-use-cases

★ 1,385

Application implementation with business use cases for safely utilizing generative AI in business operations

TypeScript

Zefan-Cai

KVCache-Factory

★ 1,380

Unified KV Cache Compression Methods for Auto-Regressive Models

Python

tmgthb

Autonomous-Agents

★ 1,377

Autonomous Agents (LLMs) research papers. Updated Daily.

GradientHQ

parallax

★ 1,376

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python

AutoArk

TinyEngram

★ 1,374

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

Python

ServiceNow

BrowserGym

★ 1,366

🌎💪 BrowserGym, a Gym environment for web task automation

Python

mohitagw15856

pm-claude-skills

★ 1,364

Claude、ChatGPT、Gemini、Cursor 和 Codex 的 822 項專業代理技能，解碼租約、編寫 PRD、運行年度股東大會、準備 D&D 會議、練習薪資談判。 Plain-markdown，MIT，在 Anthropic 的官方插件目錄中。嘗試免費的瀏覽器內或“npx pm-claude-skills add”。

HTML

morettt

This project lets you create your own AI desktop companion with customizable characters and voice conversations that respond in just 1 second. Features include long-term memory, visual recognition, voice cloning and LLM training. Compatible with various Live2D customizations.

JavaScript

ThousandBirdsInc

chidori

★ 1,364

The agent framework where every run is durable, replayable, and resumable by default.

Rust

wrtnlabs

autobe

★ 1,360

AI Vibe Coding Agent of TS backend server, enhanced by compiler skills, generating 100% working code

TypeScript

Dataojitori

nocturne_memory

★ 1,357

A lightweight, rollbackable, and visual Long-Term Memory Server for MCP Agents. Say goodbye to Vector RAG and amnesia. Empower your AI with persistent, graph-like structured memory across any model, session, or tool. Drop-in replacement for OpenClaw.

Python