LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

649–672 of 3,650

VectifyAI

OpenKB

★ 4,522

OpenKB: Open LLM Knowledge Base

Python

elementalsouls

Claude-BugHunter

★ 4,515

A Claude Code skill bundle for bug hunting and external red-team work - 82 skills, 15 slash commands, 681 disclosed-report patterns curated across 24 core vulnerability classes, plus enterprise identity + infrastructure attack matrices.

Python

FareedKhan-dev

all-agentic-architectures

★ 4,507

35 production-grade agentic AI architectures (Reflexion, LATS, GraphRAG, MemGPT, Voyager, BrowserAgent, ...) — a Python library and runnable textbook with multi-provider LLM support and a 17-task benchmark leaderboard.

Jupyter Notebook

OpenMinis

★ 4,506

OpenMinis — The AI Agent app across platforms. Fully free and open source.

Swift

ruvnet

RuVector

★ 4,502

RuVector is a High Performance, Real-Time, Self-Learning Ai, Vector GNN, Memory DB built in Rust.

Rust

FlowElement-xinliuyuansu

m_flow

★ 4,501

A bio-inspired cognitive memory engine — a new paradigm for Graph RAG.

Python

CaviraOSS

LongMemory

★ 4,499

Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc.

TypeScript

zjunlp

DeepKE

★ 4,480

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

Python

pydantic

logfire

★ 4,475

AI observability platform for production LLM and agent systems.

Python

eugeniughelbur

obsidian-second-brain

★ 4,474

Persistent memory for Claude Code and 6 other CLI agents, stored as plain markdown in your Obsidian vault. Stop re-explaining your projects, decisions and people every session. 45 commands: hybrid semantic search, self-rewriting notes, key-less web research, and scheduled agents that maintain the vault while you sleep.

Python

microsoft

LMOps

★ 4,472

General technology for enabling AI capabilities w/ LLMs and MLLMs

Python

anc95

ChatGPT-CodeReview

★ 4,463

🐥 A code review bot powered by ChatGPT

JavaScript

ArcReel

★ 4,463

AI Agent 驱动的开源可自部署视频工作台：将小说与剧本转为角色、场景、道具资产、分镜、视频和剪映草稿，支持跨镜头一致性、多供应商与费用追踪 | Self-hosted AI video workspace for stories, storyboards and short-form video production

Python

daveebbelaar

ai-cookbook

★ 4,461

Examples and tutorials to help developers build AI systems

Python

mosaicml

llm-foundry

★ 4,445

LLM training code for Databricks foundation models

Python

intuitem

ciso-assistant-community

★ 4,430

CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.

Python

zgsm-ai

costrict

★ 4,428

Costrict - strict AI coder for enterprises, quality first, including AI Agent, AI CodeReview, AI Completion.

TypeScript

conorbronsdon

avoid-ai-writing

★ 4,416

Skill that audits and rewrites content to remove AI writing patterns. Use it with your favorite agents including Claude Code, OpenClaw, Codex, and Hermes.

JavaScript

gptme

★ 4,415

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

Python