RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

289–312 of 596

endee-io

endee

★ 1,299

Endee.io – A high-performance vector database, designed to handle up to 1B vectors on a single node, delivering significant performance gains through optimized indexing and execution. Also available in cloud https://endee.io/

C++

puppyone-ai

puppyone

★ 1,299

Context drive for your AI agents

TypeScript

coleam00

claude-memory-compiler

★ 1,291

Give Claude Code a memory that evolves with your codebase. Hooks automatically capture sessions, the Claude Agent SDK extracts key decisions and lessons, and an LLM compiler organizes everything into structured, cross-referenced knowledge articles - inspired by Karpathy's LLM Knowledge Base architecture.

Python

SmythOS

sre

★ 1,291

The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across local, cloud, and edge environments.

TypeScript

neo4j

neo4j-graphrag-python

★ 1,287

Neo4j GraphRAG for Python

Python

ksimback

hermes-ecosystem

★ 1,276

Hermes Atlas — the decision layer for Hermes Agent: install guidance, mode & skill picks, and a curated catalog of 240+ ecosystem tools with live GitHub data

HTML

CommandCodeAI

BaseAI

★ 1,275

BaseAI — The Web AI Framework. The easiest way to build serverless autonomous AI agents with memory. Start building local-first, agentic pipes, tools, and memory. Deploy serverless with one command.

TypeScript

stair-lab

kg-gen

★ 1,270

[NeurIPS '25] Knowledge Graph Generation from Any Text

Python

s2b-dev

smart-second-brain

★ 1,259

A free, open-source Obsidian plugin that makes your vault smarter: better search, an interactive knowledge graph, and an AI assistant that knows your notes.

TypeScript

hexabot-ai

Hexabot

★ 1,220

Hexabot v3 is an AI workflow automation platform, combining workflows, actions, agents, and conversational channels in one runtime.

TypeScript

Deuz-AI

Deuz-SDK

★ 1,204

Zero-dependency TypeScript framework for production AI agents: durable execution, long-term memory, hybrid RAG, MCP tool calling, human-in-the-loop approval, planning and CodeAct sandboxes. One streaming API for Claude, GPT, Gemini, Grok, Mistral and DeepSeek — Node, Bun, Deno, serverless and edge.

TypeScript

superlinear-ai

raglite

★ 1,200

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Python

heymrun

heym

★ 1,198

Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.

Python

rudrankriyam

Foundation-Models-Framework-Lab

★ 1,180

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

Swift

volcengine

SearchCLI

★ 1,180

Open CLI for integrating AI search, recommendation, and conversational retrieval into agent systems and business systems

TypeScript

0xSojalSec

LLMs-local

★ 1,179

list of awesome platforms, tools, and resources run for LLMs locally

Azure-Samples

chat-with-your-data-solution-accelerator

★ 1,178

A Solution Accelerator for the RAG pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. This includes most common requirements and best practices.

Python

Azure

GPT-RAG

★ 1,177

Enterprise-grade accelerator for agentic RAG on Azure. Built on Microsoft Foundry with Foundry IQ as the default retrieval backend, Microsoft Agent Framework orchestration, Zero-Trust architecture and IaC.

Python

axoviq-ai

synthadoc

★ 1,176

Synthadoc: An open-source LLM knowledge compilation engine that turns raw documents into structured, local-first wikis. A transparent, human-readable alternative to traditional RAG, which can be self-managed and self-improved without the use of any tools.

Python

Ricky-7-Yan

intelligent-audit-system

★ 1,169

AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

Python

nico-martin

gemma4-browser-extension

★ 1,157

On-device AI agent Chrome extension powered by Transformers.js and Gemma 4

TypeScript

zjunlp

LightMem

★ 1,148

[ICLR 2026] LightMem: Lightweight and Efficient Memory-Augmented Generation

Python

codelibs

fess

★ 1,135

Open-source, self-hosted enterprise & site search server built on OpenSearch. Crawls web / file / DB / cloud sources, 20+ languages, REST API, and AI/RAG & semantic search. Apache-2.0.

Java

elastic

elastic-labs

★ 1,131

Notebooks & Example Apps for Search, Observability, and Security with Elasticsearch

Jupyter Notebook