Open-Source-LLM-Apps und -Frameworks

lenML

Speech-AI-Forge

★ 1.418

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

ARahim3

mlx-tune

★ 1.408

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

google

adk-js

★ 1.406

An open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Houseofmvps

codesight

★ 1.405

Universal AI context generator. Saves thousands of tokens per conversation in Claude Code, Cursor, Copilot, Codex, and more.

awaescher

OllamaSharp

★ 1.404

The easiest way to use Ollama in .NET

Jwuthri

Tracely-ai

★ 1.403

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

aws-samples

aws-genai-llm-chatbot

★ 1.400

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

callstackincubator

ai

★ 1.398

On-device LLM execution in React Native with Vercel AI SDK compatibility

explosion

spacy-llm

★ 1.394

🦙 Integrating LLMs into structured NLP pipelines

designcomputer

mysql_mcp_server

★ 1.391

A Model Context Protocol (MCP) server that enables secure interaction with MySQL databases

karust

openserp

★ 1.391

Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉

ovg-project

kvcached

★ 1.391

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

OWASP

www-project-top-10-for-large-language-model-applications

★ 1.391

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

aws-samples

generative-ai-use-cases

★ 1.385

Application implementation with business use cases for safely utilizing generative AI in business operations

Zefan-Cai

KVCache-Factory

★ 1.380

Unified KV Cache Compression Methods for Auto-Regressive Models

tmgthb

Autonomous-Agents

★ 1.377

Autonomous Agents (LLMs) research papers. Updated Daily.

GradientHQ

parallax

★ 1.376

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

AutoArk

TinyEngram

★ 1.374

Research of DeepSeek Engram Architecture based on Qwen-3 and Stable Diffusion series.

datawhalechina

diy-llm

★ 1.366

Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐，6 项渐进代码作业，掌握 LLM 全栈知识

ServiceNow

BrowserGym

★ 1.366

🌎💪 BrowserGym, a Gym environment for web task automation

mohitagw15856

pm-claude-skills

★ 1.364

822 professionelle Agentenfähigkeiten für Claude, ChatGPT, Gemini, Cursor und Codex, Mietvertrag entschlüsseln, PRD schreiben, Hauptversammlung leiten, D&D-Sitzung vorbereiten, Gehaltsverhandlung üben. Plain-Markdown, MIT, im offiziellen Plugin-Verzeichnis von Anthropic. Probieren Sie es kostenlos im Browser oder mit „npx pm-claude-skills add“ aus.

morettt

my-neuro

★ 1.364

This project lets you create your own AI desktop companion with customizable characters and voice conversations that respond in just 1 second. Features include long-term memory, visual recognition, voice cloning and LLM training. Compatible with various Live2D customizations.

ThousandBirdsInc

chidori

★ 1.364

The agent framework where every run is durable, replayable, and resumable by default.

wrtnlabs

autobe

★ 1.360

AI Vibe Coding Agent of TS backend server, enhanced by compiler skills, generating 100% working code