LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

265–288 of 3,650

axolotl-ai-cloud

axolotl

★ 12,475

Go ahead and axolotl questions

Python

Chainlit

chainlit

★ 12,452

Build Conversational AI in minutes ⚡️

Python

simular-ai

Agent-S

★ 12,301

Agent S: an open agentic framework that uses computers like a human

Python

TheR1D

shell_gpt

★ 12,284

A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

Python

elie222

inbox-zero

★ 12,215

The world's best AI personal assistant for email. Open source app to help you reach inbox zero fast.

TypeScript

FlagOpen

FlagEmbedding

★ 12,162

Retrieval and Retrieval-augmented LLMs

Python

kubeshark

★ 12,084

eBPF-powered network observability for Kubernetes. Indexes L4/L7 traffic with full K8s context, decrypts TLS without keys. Queryable by AI agents via MCP and humans via dashboard.

mrexodia

ida-pro-mcp

★ 12,068

AI-powered reverse engineering assistant that bridges IDA Pro with language models through MCP.

Python

jina-ai

reader

★ 12,000

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

TypeScript

dataelement

bisheng

★ 11,968

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Python

0x4m4

hexstrike-ai

★ 11,888

HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.

Python

ludwig-ai

ludwig

★ 11,755

Low-code framework for building custom LLMs, neural networks, and other AI models

Python

cocoindex-io

cocoindex

★ 11,557

Incremental engine for long horizon agents 🌟 Star if you like it!

Rust

Jeffallan

claude-skills

★ 11,484

67 Specialized Skills for Full-Stack Developers. Transform Claude Code into your expert pair programmer.

Python

wangrongding

wechat-bot

★ 11,362

🤖 Multi-platform IM AI Agent for Telegram, WhatsApp, Lark, and WeChat. Connects ChatGPT / Claude / Kimi / DeepSeek / Ollama / Pi for auto-replies, community analysis, contact management, and inactive-friend detection.

JavaScript

MemTensor

MemOS

★ 11,355

Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings.

TypeScript

holaboss-ai

holaOS

★ 11,288

Open-source agentic workspace enterprises can make their own. Connect the systems you already run — 100+ integrations, MCP, chat tools, apps, browser, local files — with shared memory. Any agent (Claude Code, Codex), any model, or BYOK. Set up in clicks, not months. Local-first: your data never leaves your machines.

TypeScript

corsairdev

corsair

★ 11,282

Connect your users to their apps

TypeScript

wandb

★ 11,249

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

Python

microsoft

promptflow

★ 11,241

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Python

cobusgreyling

loop-engineering

★ 11,221

Practical patterns, starters & CLI tools for loop engineering with AI coding agents. Design systems that prompt and orchestrate agents (inspired by Addy Osmani and Boris Cherny). Includes loop-audit, loop-init, loop-cost.

TypeScript