大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組：聊天介面、SDK 與框架、提示詞與評測工具，以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型，有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話，先確認三件事：授權——有些熱門專案限制商用；是否支援你正在用的模型服務商；以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 481–504 個，共 866 個

keon

browser-control

★ 3,144

A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.

Rust

zjunlp

LLMAgentPapers

★ 3,117

Must-read Papers on LLM Agents.

TanStack

ai

★ 3,116

🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.

TypeScript

wquguru

harness-books

★ 3,111

📚 Two books on harness engineering — the design philosophies behind Claude Code & Codex: constraints, query loops, context governance, multi-agent verification. harness-books.agentway.dev

Python

ridgerchu

matmulfreellm

★ 3,093

Implementation for MatMul-free LM.

Python

decodingai-magazine

second-brain-ai-assistant-course

★ 3,088

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

Jupyter Notebook

amitshekhariitbhu

ai-engineering-interview-questions

★ 3,085

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Markdown

KhazP

vibe-coding-prompt-template

★ 3,082

Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs

TypeScript

GH05TCREW

pentestagent

★ 3,081

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Python

SharpAI

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.

JavaScript

ahujasid

ableton-mcp

★ 3,061

Control Ableton Live with any LLM: create tracks, arrange clips & compose music via MCP

Python

b4rtaz

distributed-llama

★ 3,059

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

C++

containers

ramalama

★ 3,051

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Python

pinecone-io

examples

★ 3,043

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

Jupyter Notebook

dwgx

WindsurfAPI

★ 3,014

Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。

JavaScript

Simon-He95

markstream-vue

★ 3,010

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.

Vue

eracle

OpenOutreach

★ 3,008

Open-source AI agent for B2B lead generation — describe your product, it finds the people who fit, explains why each one does, and emails them from your mailbox. Self-hosted CLI, one install.

Python