LLM-Apps

Open-Source-LLM-Apps und -Frameworks

Das ist die breiteste Gruppe: Chat-Oberflächen, SDKs und Frameworks, Werkzeuge für Prompts und Evaluierung sowie Anwendungen, die auf großen Sprachmodellen aufbauen. Viele funktionieren mit Modellen verschiedener Anbieter, manche können Modelle auf Ihrer eigenen Hardware ausführen.

Worauf Sie achten sollten

Wenn Sie etwas produktiv einsetzen wollen, prüfen Sie zuerst drei Fakten: die Lizenz, denn manche beliebten Projekte schränken die kommerzielle Nutzung ein; ob der Modellanbieter unterstützt wird, den Sie bereits nutzen; und ob das Projekt noch gepflegt wird. Der Kasten „Auf einen Blick“ auf jeder Projektseite beantwortet die Fragen zu Lizenz und Pflege anhand von GitHub-Daten.

Projekte mit den meisten Sternen

673–696 von 871

MorDavid

BruteForceAI

★ 1.708

Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks

Python

NeoLabHQ

context-engineering-kit

★ 1.702

Hand-crafted Claude Code Skills focused on improving agent results quality. Compatible with OpenCode, Cursor, Antigravity, Gemini CLI, and others. Includes CodeRabbit open-source alternative.

TypeScript

kubeflow

katib

★ 1.701

Automated Machine Learning on Kubernetes

Python

kwaroran

Risuai

★ 1.681

Make your own story. User-friendly software for LLM roleplaying

TypeScript

lotus-data

lotus

★ 1.681

Optimized Agentic and LLM Bulk Processing Over Your Data

Python

SemiAnalysisAI

InferenceX

★ 1.676

Open Source Continuous Inference Benchmark Research Platform, Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 – GB200 NVL72 vs. MI355X vs. B200 vs. GB300 NVL72 und bald TPUv6e/v7/Trainium2/3 | , Kimi K2.7-Code MiniMax M3 DeepSeekv4 GLM5 – GB200 NVL72 vs. MI355X vs. B200 vs. GB300 NVL72 TPUv6e/v7/Trainium2/3.

Python

gi-dellav

zerostack

★ 1.673

Lightweight coding agent written in Rust, optimized for memory footprint and performance

Rust

tenstorrent

tt-metal

★ 1.673

TT-NN-Operatorbibliothek und TT-Metalium-Low-Level-Kernel-Programmiermodell.

C++

intentee

paddler

★ 1.672

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Rust

Gitlawb

zero

★ 1.671

Der Programmieragent, der auf Sie, Ihr Modell, Ihre Maschine, Ihre Regeln reagiert.

AgentR1

Agent-R1

★ 1.669

Agent-R1: Training Powerful LLM Agents with End-to-End Reinforcement Learning

Python

PurpleDoubleD

locally-uncensored

★ 1.667

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

TypeScript

FrigadeHQ

trench

★ 1.663

Trench — Open-Source Analytics Infrastructure. A single production-ready Docker image built on ClickHouse, Kafka, and Node.js for tracking events. Easily build product analytics dashboards, LLM RAGs, observability platforms, or any other analytics product.

TypeScript

legeling

PromptHub

★ 1.653

一款包含了 Prompt管理，Skill管理，Agent管理的一站式AI工具箱，助你高效管理提示词，一键分发skills ，一站式管理Agent资产，并实现云同步，备份，版本管理 | An all-in-one AI toolbox for prompt, agent, and skills management. Reuse prompts, distribute skills with one click, manage agent assets, and support cloud sync, backup, and version control

TypeScript

Tencent

AngelSlim

★ 1.651

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Python

masamasa59

ai-agent-papers

★ 1.649

A collection of AI Agents papers (Updated biweekly)

Python

patoles

agent-flow

★ 1.647

Real-time visualization of Claude Code agent orchestration — see your agents think, branch, and coordinate as they work.

TypeScript

theopenco

llmgateway

★ 1.641

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

TypeScript

mediar-ai

terminator

★ 1.639

playwright for windows computer use

Rust

fetchai

uAgents

★ 1.636

A fast and lightweight framework for creating decentralized agents with ease.

Python

psalias2006

gpu-hot

★ 1.636

🔥 Real-time NVIDIA GPU dashboard

JavaScript

nasa-jpl

rosa

★ 1.634

ROSA 🤖 is an AI Agent designed to interact with ROS1- and ROS2-based robotics systems using natural language queries. ROSA helps robot developers inspect, diagnose, understand, and operate robots.

Python

pguso

rag-from-scratch

★ 1.629

Demystify RAG by building it from scratch. Local LLMs, no black boxes - real understanding of embeddings, vector search, retrieval, and context-augmented generation.

JavaScript

Darkatse

TauriTavern

★ 1.624

The classic Sillytavern, now has been rewritten in Tauri/Rust.

JavaScript