LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

3,169–3,192 of 4,151

VILA-Lab

FigMirror

★ 516

An Automated AI Agent Tool for Plotting Your Data in Any Paper's Figure Style.

Python

pab1it0

prometheus-mcp-server

★ 515

A Model Context Protocol (MCP) server that enables AI agents and LLMs to query and analyze Prometheus metrics through standardized interfaces.

Python

zolotukhin

zinc

★ 515

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon

Zig

AnxForever

stylekit

★ 514

精选优质 Web 设计风格，提供文档、组件模板、代码片段，以及可直接导出的 AI Rules。

TypeScript

aqm857886159

Nomi

★ 514

Open-source AI video workbench. Bring any model or your local ComfyUI, and let Claude Code / Codex / Cursor direct it over MCP — storyboard, references, generation, editable first cut on a real timeline. Local-first: projects, prompts, and keys stay on your machine. No account, no telemetry.

TypeScript

blacktwist

social-media-skills

★ 514

AI agent skills for social media content strategy, creation, and analysis across text-first platforms

Shell

canarybyte

veridrop

★ 514

AI API 中转站检测工具：Claude 中转站检测、OpenAI 中转站检测、Gemini 中转站检测，中转站真伪检测、长上下文验证、思维签名验证、中转站红黑榜，自托管开源。

Python

codejunkie99

graph-engineering

★ 514

Graph engineering for AI agents: the 9-stage knowledge-graph pipeline (translated from SEU's graduate course) + task-graph orchestration patterns, as a Claude skill with teaching mode and paste-ready workflows

mikexcohen

ML4LLM_book

★ 514

Code and materials for my book "50 ML projects to understand LLMs"

Jupyter Notebook

Sentient-OS-Labs

sentient-os

★ 514

An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

Swift

codexstar69

bug-hunter

★ 513

Adversarial AI bug hunter with auto-fix skill for Claude Code, Cursor, Codex CLI, GitHub Copilot CLI, Kiro CLI, Opencode, Pi Coding Agent, and more. Multi-agent pipeline finds security vulnerabilities, logic errors, and runtime bugs — then fixes them autonomously on a safe branch.

JavaScript

seratch

ChatGPT-in-Slack

★ 513

Swift demonstration of how to build a Slack app that enables end-users to interact with a ChatGPT bot

Python

adshao

flounder

★ 512

Autonomous white-hat security auditor for AI-driven code review, bug bounty research, exploit construction, and execution-grounded verification.

TypeScript

apocas

restai

★ 512

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

Python

fabio-rovai

open-ontologies

★ 512

AI-native ontology engine: a Rust MCP server with tools for building, validating, querying, and reasoning over RDF/OWL ontologies. In-memory Oxigraph triple store, native OWL2-DL tableaux reasoner, SHACL validation, SPARQL, versioning. Single binary, no JVM.

Rust

KubeezMedia

kubeez-scroll-world-video

★ 512

Scroll-scrubbed 'fly through the world' burger demo, generated with Kubeez. Live: meepcastana.github.io/kubeez-scroll-world-video

JavaScript

Th0rgal

sandboxed.sh

★ 512

Safe runtime for autonomous on-chain AI agents: isolated sandboxes, Library skills, encrypted secrets.

Rust

Undertone0809

promptulate

★ 512

🚀Lightweight Large language model automation and Autonomous Language Agents development framework. Build your LLM Agent Application in a pythonic way!

Python