KI-Kanal
LLM-Apps

Open-Source-LLM-Apps und -Frameworks

Das ist die breiteste Gruppe: Chat-Oberflächen, SDKs und Frameworks, Werkzeuge für Prompts und Evaluierung sowie Anwendungen, die auf großen Sprachmodellen aufbauen. Viele funktionieren mit Modellen verschiedener Anbieter, manche können Modelle auf Ihrer eigenen Hardware ausführen.

Worauf Sie achten sollten

Wenn Sie etwas produktiv einsetzen wollen, prüfen Sie zuerst drei Fakten: die Lizenz, denn manche beliebten Projekte schränken die kommerzielle Nutzung ein; ob der Modellanbieter unterstützt wird, den Sie bereits nutzen; und ob das Projekt noch gepflegt wird. Der Kasten „Auf einen Blick“ auf jeder Projektseite beantwortet die Fragen zu Lizenz und Pflege anhand von GitHub-Daten.

Projekte mit den meisten Sternen

481–504 von 871
TanStack

ai

3.116

🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Svelte, and Solid.

TypeScript
3.111

📚 Two books on harness engineering — the design philosophies behind Claude Code & Codex: constraints, query loops, context governance, multi-agent verification. harness-books.agentway.dev

Python
ridgerchu

matmulfreellm

3.093

Implementation for MatMul-free LM.

Python
3.088

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

Jupyter Notebook

Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs

TypeScript
GH05TCREW

pentestagent

3.081

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Python
SharpAI

DeepCamera

3.062

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.

JavaScript
ahujasid

ableton-mcp

3.061

Control Ableton Live with any LLM: create tracks, arrange clips & compose music via MCP

Python
3.059

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

C++
containers

ramalama

3.051

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Python
pinecone-io

examples

3.043

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

Jupyter Notebook
3.028

A agent framework based on the tutorial hello-agents

Python
3.014

Turn Windsurf / Devin Desktop's 100+ AI models (Claude, GPT, Gemini, DeepSeek, Kimi, GLM, SWE) into OpenAI-, Anthropic- & Gemini-compatible APIs. Zero-dependency self-hosted reverse proxy for Claude Code, Cline & Cursor. 把 Windsurf/Devin 云端 100+ 模型变成三套兼容 API。

JavaScript
Simon-He95

markstream-vue

3.010

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.

Vue
3.008

Open-source AI agent for B2B lead generation — describe your product, it finds the people who fit, explains why each one does, and emails them from your mailbox. Self-hosted CLI, one install.

Python
Dicklesworthstone

llm_aided_ocr

3.000

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs

Python
thu-pacman

chitu

2.998

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

Python
vercel-labs

opensrc

2.983

Fetch source code for npm packages to give AI coding agents deeper context

Rust
AlephAITech

WorkBuddyGuide

2.960

Ein praktischer Open-Source-Leitfaden zur Beherrschung von WorkBuddy durch reale Arbeitsabläufe.

Python
supabase-community

database-build

2.954

In-browser Postgres sandbox with AI assistance (formerly postgres.new)

TypeScript
2.952

🎭 AI 写小说:从零生成 10-50 章完整中文小说,三层问答 · 创作记忆 · 悬念钩子 · 自动校验,长篇网文连载皆宜|开源免费,适配主流 coding agent|AI novel writing skill

Python
michaelfeil

infinity

2.941

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Python
2.934

Dieses Projekt rundet „This project helps teams deliver faster with open-source tooling and practical workflows.“ zu einer praxistauglichen Open-Source-Lösung zusammen, mit wiederverwendbarer Tooling- und Integrationsunterstützung für reale Anwendungsfälle.

JavaScript