RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

241–264 of 596

ray-project

llm-applications

★ 1,857

A comprehensive guide to building RAG-based LLM applications for production.

Jupyter Notebook

thinkwee

AgentsMeetRL

★ 1,842

Awesome List for Agentic RL

HTML

u14app

neo-chat

★ 1,826

A local-first AI chat workspace for models, agents, skills, plugins, search, RAG, voice, memory, and artifacts.

TypeScript

robustmq

★ 1,803

Communication infrastructure for the AI era, one binary, one broker, one storage layer, any protocol.

Rust

onestardao

WFGY

★ 1,791

WFGY is heading toward WFGY 5.0 Polaris Protocol, a major open-source release for AI reasoning, RAG, agents, and real-world workflows. Includes Problem Map, Global Debug Card, WFGY 4.0, and the CFV Easter Egg.

Jupyter Notebook

trpc-group

trpc-agent-go

★ 1,787

A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

xhluca

bm25s

★ 1,785

Fast BM25 search in Python, powered by Numpy and Numba

Python

SmartFlowAI

EmoLLM

★ 1,783

心理健康大模型 (LLM x Mental Health), Pre & Post-training & Dataset & Evaluation & Depoly & RAG, with InternLM / Qwen / Baichuan / DeepSeek / Mixtral / LLama / GLM series models

Python

neuml

paperai

★ 1,779

📄 🤖 AI for medical and scientific papers

Python

hwdsl2

openvpn-install

★ 1,740

OpenVPN server installer for Ubuntu, Debian, AlmaLinux, Rocky Linux, CentOS, Fedora, openSUSE, Amazon Linux and Raspberry Pi OS. Includes interactive setup and client management.

Shell

undreamai

LLMUnity

★ 1,708

Create characters in Unity with LLMs!

LLPhant

★ 1,707

LLPhant - A comprehensive PHP Generative AI Framework using OpenAI GPT 4. Inspired by Langchain

PHP

deepsense-ai

ragbits

★ 1,667

Building blocks for rapid development of GenAI applications

Python

FrigadeHQ

trench

★ 1,663

Trench — Open-Source Analytics Infrastructure. A single production-ready Docker image built on ClickHouse, Kafka, and Node.js for tracking events. Easily build product analytics dashboards, LLM RAGs, observability platforms, or any other analytics product.

TypeScript

emarco177

langchain-course

★ 1,661

A project-based course repository for developing AI agents using LangChain v1+ and LangGraph: search agents, RAG systems, reflection agents, and code interpreters.

Lynpoint

CyberVerse

★ 1,648

Self hosted, real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.

Python

pguso

rag-from-scratch

★ 1,629

Demystify RAG by building it from scratch. Local LLMs, no black boxes - real understanding of embeddings, vector search, retrieval, and context-augmented generation.

JavaScript

NirDiamant

Controllable-RAG-Agent

★ 1,625

This repository provides an advanced Retrieval-Augmented Generation (RAG) solution for complex question answering. It uses sophisticated graph based algorithm to handle the tasks.

Jupyter Notebook

pixeltable

★ 1,621

The unified multimodal backend for AI data apps. Database, orchestration, and serving in one Python file.

Python

activeloopai

hivemind

★ 1,615

Hivemind turns your traces into reusable skills across agents

TypeScript

lucasastorian

llmwiki

★ 1,611

Open Source Implementation of Karpathy's LLM Wiki. Upload documents, connect your Claude account via MCP, and have it write your wiki !

Python

BAI-LAB

MemoryOS

★ 1,577

[EMNLP 2025 Oral] MemoryOS is designed to provide a memory operating system for personalized AI agents.

Python

zzet

gortex

★ 1,575

High-performance code-intelligence engine for AI agents and IDE, supports 257 languages, multi repositories, based on graph, with access via CLI, MCP Server, and API. AI coding agents teammate - expose only needed information, cutting token usage up to 50x. 100% local. Discord:.

MLSysOps

MLE-agent

★ 1,571

🤖 MLE-Agent: Your intelligent companion for seamless AI engineering and research. 🔍 Integrate with arxiv and paper with code to provide better code/research plans 🧰 OpenAI, Anthropic, Gemini, Ollama, etc supported. :fireworks: Code RAG

Python