AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,225–1,248 of 4,628
ahujasid

ableton-mcp

★ 3,124

Control Ableton Live with any LLM: create tracks, arrange clips & compose music via MCP

Python
★ 3,120

Open-source AI agent for B2B lead generation — describe your product, it finds the people who fit, explains why each one does, and emails them from your mailbox. Self-hosted CLI, one install.

Python
★ 3,120

Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs

TypeScript
MiroMindAI

MiroFlow

★ 3,116

🏆 Top-1 on 5+ benchmarks | Web UI | Supports MiroThinker, Claude, Kimi, OpenAI

Python
MaxMiksa

Auto-Company

★ 3,115

An auto-company works for 24/7 on your own PC - Windows/Linux/macOS.

Python
GH05TCREW

pentestagent

★ 3,114

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Python
anthropics

commerce-agents

★ 3,113

Reference blueprint for building shopping and merchant agents with Claude. Examples in retail, commerce, telecom, and entertainment included.

Python
★ 3,110

Supports comfyui/API calls/modelscope calls

Python
★ 3,110

Make any agent harness multimodal-native.

Python
xiamuceer-j

MuMuAINovel

★ 3,103

一款基于 AI 的智能小说创作助手，帮助你轻松创作精彩故事

Python
★ 3,100

Turn code into clarity. Generate accurate technical docs and AI-ready context in minutes—perfectly structured for human teams and intelligent agents.

Rust
★ 3,098

Learn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.

Jupyter Notebook
★ 3,098

AI reads books: Page-by-Page PDF Knowledge Extractor & Summarizer. script performs an intelligent page-by-page analysis of PDF books, methodically extracting knowledge points and generating progressive summaries at specified intervals

Python
★ 3,097

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

C++
spiceai

spiceai

★ 3,097

Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.

Rust
ridgerchu

matmulfreellm

★ 3,092

Implementation for MatMul-free LM.

Python
★ 3,089

A practical Claude Code guide with clear mental models and copy-paste examples — setup, prompt engineering, slash commands, skills, hooks, subagents, agent teams, and MCP servers. Beginner path to power-user depth. Featured in Awesome Claude Code.

Python
Nutlope

self.so

★ 3,088

LinkedIn -> personal site generator

TypeScript
★ 3,084

This project helps teams deliver faster with open-source tooling and practical workflows.

JavaScript
SharpAI

DeepCamera

★ 3,080

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understands, remembers & guards your home via Telegram, Discord or Slack. Pluggable AI skills. OpenAI, Google, Anthropic or local AI. Runs on Mac Mini & AI PC.

JavaScript
★ 3,078

cursor-byok is a local implementation of Cursor's backend

Rust