LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

97–120 of 4,622

ComposioHQ

composio

★ 30,331

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

TypeScript

tobi

qmd

★ 30,087

mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local

TypeScript

decolua

9router

★ 30,028

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

JavaScript

modular

★ 29,898

The Modular Platform (includes MAX & Mojo)

Mojo

assafelovic

gpt-researcher

★ 29,803

An autonomous agent that conducts deep research on any data using any LLM providers.

Python

labring

FastGPT

★ 29,770

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

TypeScript

NirDiamant

RAG_Techniques

★ 29,631

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

Jupyter Notebook

ahujasid

blender-mcp

★ 29,630

Community plugin to control Blender 3D with any LLM of your choice

Python

The-Art-of-Hacking

h4cker

★ 29,572

This repository is maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), AI security, vulnerability research, exploit development, reverse engineering, and more. 🔥 Also check: https://hackertraining.org

Jupyter Notebook

oraios

serena

★ 29,531

A powerful MCP toolkit for coding, providing semantic retrieval and editing capabilities - the IDE for your agent

Python

openai

openai-agents-python

★ 29,523

A lightweight, powerful framework for multi-agent workflows. On Windows, use DockerSandboxClient with the openai-agents[docker] extra or a hosted sandbox client instead; see Sandbox clients for setup details.

Python

gitleaks

★ 29,363

Find secrets with Gitleaks 🔑

HandsOnLLM

Hands-On-Large-Language-Models

★ 29,151

Official code repo for the O'Reilly Book - "Hands-On Large Language Models"

Jupyter Notebook

tastejs

todomvc

★ 28,955

Helping you select a JavaScript framework - Todo apps for React.js, Angular, Vue and many more

JavaScript

Anil-matcha

Open-Generative-AI

★ 28,678

Unrestricted Open-source alternative to AI video platforms — Free AI image & video generation studio with 600+ models (Flux, Midjourney, Kling, Sora, Veo). No content filters. Self-hosted, MIT licensed.

JavaScript

microsoft

semantic-kernel

★ 28,607

Semantic Kernel connects application code with language models, prompts, tools, memory, and agent workflows.

yamadashy

repomix

★ 28,580

📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

TypeScript

srbhr

Resume-Matcher

★ 28,524

The #1 AI Harness for Building Resumes, PDFs, Cover Letters & more, locally with 100+ LLMs support.

Python

ATH-MaaS

Pixelle-Video

★ 28,518

🚀 AI 全自动短视频引擎 | AI Fully Automated Short Video Engine

Python

charmbracelet

crush

★ 28,362

Glamourous agentic coding for all 💘

OtterMind

Chat2DB

★ 28,290

Chat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.

Java