AI 頻道
大型語言模型應用

開源大型語言模型應用與框架

這是範圍最廣的一組:聊天介面、SDK 與框架、提示詞與評測工具,以及各種以大型語言模型為基礎的應用。很多專案可以接入多家服務商的模型,有些還能在你自己的硬體上執行模型。

怎麼選

打算用在產品裡的話,先確認三件事:授權——有些熱門專案限制商用;是否支援你正在用的模型服務商;以及它是否還在維護。每個專案頁上的「秒懂」卡片會根據 GitHub 資料回答授權和維護這兩個問題。

星數最多的專案

第 169–192 個,共 866 個
Open-LLM-VTuber

Open-LLM-VTuber

13,776

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

Python
browseros-ai

BrowserOS

13,677

🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.

TypeScript
Lightning-AI

litgpt

13,665

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python
doocs

md

13,330

✍ WeChat Markdown Editor | 一款高度简洁的微信 Markdown 编辑器:支持 Markdown 语法、自定义主题样式、内容管理、多图床、AI 助手等特性

TypeScript
13,236

✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地:源码解析、系统设计与工程实践笔记

Go
langchain4j

langchain4j

13,100

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Java
ShishirPatil

gorilla

13,023

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

Python
13,011

A Claude skill that writes the accurate prompts for any AI tool. Zero tokens or credits wasted. Full context and memory retention

Portkey-AI

gateway

13,000

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

TypeScript
EverMind-AI

EverOS

12,978

One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.

Python
PaddlePaddle

PaddleNLP

12,972

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Python
neuml

txtai

12,949

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

Python
StarTrail-org

LEANN

12,940

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Python
codexu

note-gen

12,806

一款跨平台的 Markdown AI 筆記型軟體。這是為了確保有用的碎片在你有時間把它們變成完整的東西之前不會消失。

TypeScript
bentoml

OpenLLM

12,531

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python
axolotl-ai-cloud

axolotl

12,475

Go ahead and axolotl questions

Python
Chainlit

chainlit

12,452

Build Conversational AI in minutes ⚡️

Python
TheR1D

shell_gpt

12,284

A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

Python
12,162

Retrieval and Retrieval-augmented LLMs

Python
jina-ai

reader

12,000

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

TypeScript
dataelement

bisheng

11,968

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Python
11,888

HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.

Python
ludwig-ai

ludwig

11,755

Low-code framework for building custom LLMs, neural networks, and other AI models

Python