RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

97–120 of 596

plastic-labs

honcho

★ 7,180

Memory library for building stateful agents

Python

xerrors

Yuxi

★ 7,007

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

Python

adbar

trafilatura

★ 6,821

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Python

dataease

SQLBot

★ 6,801

🔥 基于大模型和 RAG 的智能问数系统，对话式数据分析神器。Text-to-SQL Generation via LLMs using RAG.

JavaScript

AIPentest

CyberStrikeAI

★ 6,765

The system of action for AI-native cybersecurity—where intent becomes governed execution, evidence becomes operational memory, and every operation improves the next.

nndl

llm-beginner

★ 6,746

《大模型与智能体》电子书与 6 个编程任务：Transformer、mini-GPT、SFT/DPO、RAG、工具调用与编程智能体。

Python

pig-mesh

pig

★ 6,685

↥ ↥ ↥ Follow for updates An RBAC permission management system based on Spring Cloud 2025, Spring Boot 4, and OAuth2.

Java

airweave-ai

airweave

★ 6,565

Open-source context retrieval layer for AI agents. Open-source context retrieval layer for AI agents and RAG systems.

Python

Osmantic

ODS

★ 6,488

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Python

genkit-ai

genkit

★ 6,441

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

TypeScript

MaterializeInc

materialize

★ 6,367

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

Rust

cactus-compute

cactus

★ 6,017

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

C++

clusterzx

paperless-ai

★ 5,944

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

JavaScript

HelixDB

helix-db

★ 5,907

HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.

Rust

ModelEngine-Group

nexent

★ 5,863

Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles, unified tools, skills, memory, and orchestration with built-in constraints, feedback loops, and control planes.

Python

Giskard-AI

giskard-oss

★ 5,815

🐢 Open-Source Evaluation & Testing library for LLM Agents

Python

PySpur-Dev

pyspur

★ 5,786

A visual playground for agentic workflows: Iterate over your agents 10x faster

TypeScript

potpie-ai

potpie

★ 5,722

Context Graph for AI Native SDLC. Potpie turns your codebase and software development lifecycle into a living context graph for AI agents.

Python

ageerle

ruoyi-ai

★ 5,698

An enterprise AI development framework for building AI agents. It provides unified management of multi-provider LLMs, secure enterprise knowledge bases with high-precision retrieval, visual workflow orchestration and multi-agent coordination. Compatible with mainstream Agent Skill standards, it enables developers to efficiently build production-gra

Java

OpenBMB

UltraRAG

★ 5,694

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python

the-open-agent

openagent

★ 5,621

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org