LLM-Apps

Open-Source-LLM-Apps und -Frameworks

Das ist die breiteste Gruppe: Chat-Oberflächen, SDKs und Frameworks, Werkzeuge für Prompts und Evaluierung sowie Anwendungen, die auf großen Sprachmodellen aufbauen. Viele funktionieren mit Modellen verschiedener Anbieter, manche können Modelle auf Ihrer eigenen Hardware ausführen.

Worauf Sie achten sollten

Wenn Sie etwas produktiv einsetzen wollen, prüfen Sie zuerst drei Fakten: die Lizenz, denn manche beliebten Projekte schränken die kommerzielle Nutzung ein; ob der Modellanbieter unterstützt wird, den Sie bereits nutzen; und ob das Projekt noch gepflegt wird. Der Kasten „Auf einen Blick“ auf jeder Projektseite beantwortet die Fragen zu Lizenz und Pflege anhand von GitHub-Daten.

Projekte mit den meisten Sternen

361–384 von 871

llm-d

★ 4.562

Achieve state of the art inference performance with modern accelerators on Kubernetes

Shell

VectifyAI

OpenKB

★ 4.522

OpenKB: Open LLM Knowledge Base

Python

FareedKhan-dev

all-agentic-architectures

★ 4.507

35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, BrowserAgent, ...) — a Python library and runnable textbook with multi-provider LLM support and a 17-task benchmark leaderboard.

Jupyter Notebook

FlowElement-xinliuyuansu

m_flow

★ 4.501

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

Python

CaviraOSS

LongMemory

★ 4.499

Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.

TypeScript

microsoft

LMOps

★ 4.472

General technology for enabling AI capabilities w/ LLMs and MLLMs

Python

daveebbelaar

ai-cookbook

★ 4.461

Examples and tutorials to help developers build AI systems

Python

mosaicml

llm-foundry

★ 4.445

LLM training code for Databricks foundation models

Python

intuitem

ciso-assistant-community

★ 4.430

CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.

Python

conorbronsdon

avoid-ai-writing

★ 4.416

Skill that audits and rewrites content to remove AI writing patterns. Use it with your favorite agents including Claude Code, OpenClaw, Codex, and Hermes.

JavaScript

gptme

★ 4.415

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

Python

open-compass

VLMEvalKit

★ 4.394

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Python

cs-lazy-tools

ChatGPT-On-CS

★ 4.392

拼多多、千牛、抖店 AI 客服机器人：自动回复客户咨询、商品答疑、售后申诉处理，支持微信、小红书、京东、抖音、B站、微博等多平台统一接待；可接入 DeepSeek / 通义千问等大模型，支持自有知识库定制。

TypeScript

walkinglabs

hands-on-modern-rl

★ 4.391

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

Python

crmne

ruby_llm

★ 4.376

One delightful Ruby framework for every major AI provider. Build AI agents, chatbots, RAG apps, and multimodal workflows in beautiful, expressive code.

Ruby

antvis

mcp-server-chart

★ 4.365

🤖 A visualization mcp & skills contains 25+ visual charts using @antvis. Using for chart generation and data analysis.

TypeScript

datawhalechina

llms-from-scratch-cn

★ 4.364

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6，深入理解大模型原理

Jupyter Notebook

SenteLabsAI

OpenExecutive

★ 4.320

AI-powered virtual executive team — a single coherent executive persona backed by 8 specialist agents (FastAPI + Next.js).

Python

ModelTC

LightLLM

★ 4.290

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Python

IvanMurzak

Unity-MCP

★ 4.278

AI Skills, MCP Tools, and CLI for Unity Engine. Full AI develop and test loop. Use cli for quick setup. Efficient token usage, advanced tools. Any C# method may be turned into a tool by a single line. Works with Claude Code, Gemini, Copilot, Cursor and any other absolutely for free.

StructuredLabs

preswald

★ 4.270

Preswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable completely in-browser, using Pyodide, DuckDB, Pandas, and Plotly, Matplotlib, etc. Build dashboards, reports, and notebooks that run offline, load fast, and share like a document.

Python