RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

457–480 of 596

thiswillbeyourgithub

wdoc

★ 543

Summarize and query from a lot of heterogeneous documents. Any LLM provider, any filetype, advanced RAG, advanced summaries, scriptable, etc

Python

awslabs

generative-ai-cdk-constructs

★ 541

AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.

TypeScript

NarimanN2

ollama-playground

★ 541

Interesting LLM projects that I created for my YouTube channel using Ollama's open-source models.

Python

tonykipkemboi

ollama_pdf_rag

★ 540

A full-stack demo showcasing a local RAG (Retrieval Augmented Generation) pipeline to chat with your PDFs.

TypeScript

liaotxcn

Weave

★ 538

A highly efficient, secure, and stable application development platform with excellent performance, easy scalability, and deep integration of AI capabilities such as LLM, AI Chat, RAG, and Agents.高效、安全、稳定的服务研发平台，具备良好性能，同时易扩展，深度集成LLM、AIChat、RAG、Agent等AI能力

Haozhe-Xing

agent_learning

★ 533

A systematic AI Agent development tutorial covering LLM agents, RAG, tool use, memory systems, multi-agent systems, LangChain, LangGraph, MCP, and agentic RL.｜从零开始学 AI Agent 开发 | 系统、全面、实战导向的 Agent 开发教程 | 每日自动追踪 arXiv 最新论文 | Learn AI Agent Development from Scratch

HTML

evanhu1

talk2arxiv

★ 529

Talk to any ArXiv paper using ChatGPT

TypeScript

automataIA

graphrag-rs

★ 527

GraphRAG-rs is a high-performance, state-of-the-art Rust implementation of GraphRAG (Graph-based Retrieval Augmented Generation) that builds knowledge graphs from documents and enables natural language querying with configurable entity extraction and local LLM integration

Rust

unbody-io

unbody

★ 524

The Supabase of AI era. A modular, open-source backend for building AI-native software — designed for knowledge, not static data.

TypeScript

LeDat98

NexusRAG

★ 521

Hybrid RAG system combining vector search, knowledge graph (LightRAG), and cross-encoder reranking — with Docling document parsing, visual intelligence (image/table captioning), agentic streaming chat, and inline citations. Powered by Gemini or local Ollama models.

Python

relari-ai

continuous-eval

★ 517

Data-Driven Evaluation for LLM-Powered Applications

Python

caura-ai

caura

★ 516

Caura (formerly MemClaw) — governed shared memory for AI agent fleets. Multi-agent, multi-tenant, MCP-native. Trust tiers, keystone policies, audit trails, knowledge graph, self-improving retrieval. Apache 2.0.

Python

supabase-community

chatgpt-your-files

★ 516

Production-ready MVP for securely chatting with your documents using pgvector

TypeScript

apocas

restai

★ 512

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

Python

Undertone0809

promptulate

★ 512

🚀Lightweight Large language model automation and Autonomous Language Agents development framework. Build your LLM Agent Application in a pythonic way!

Python

buynao

aipath

★ 509

Interactive AI General Education Course — 30 Lessons, Zero Math

JavaScript

codejunkie99

graph-engineering

★ 507

Graph engineering for AI agents: the 9-stage knowledge-graph pipeline (translated from SEU's graduate course) + task-graph orchestration patterns, as a Claude skill with teaching mode and paste-ready workflows

Azure-Samples

rag-postgres-openai-python

★ 505

A RAG app to ask questions about rows in a database table. Deployable on Azure Container Apps with PostgreSQL Flexible Server.

Python

Zchary1106

agent-interview-hub

★ 504

AI Agent 工程师面试资料库 - 国内大厂面经、岗位要求、高频面试题

HTML

intelligencedev

manifold

★ 497

Manifold is an experimental platform for enabling long horizon workflow automation using teams of AI assistants.

eidolon-ai

eidolon

★ 492

The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications

Python

ZeroTang05

cyber-doctor

★ 492

赛博医生项目——”赛博华佗“，基于多模态大模型的多功能智能体，一键搭建本地多模态大模型。接入医疗健康相关的知识图谱和知识库后可以进行疾病初诊，病历分析，专业知识问答等功能，成为你的私人医生。赛博华佗项目能帮助实现医疗资源的跨地域传播，让更多人借助大模型改善健康水平。"Cyber Huatuo" - Easy to build a personal doctor agent based on LLM and Knowledge Graph/Knowledge Database.

Python

Ikalus1988

MisakaNet

★ 491

📚 A zero-dependency, git-backed micro-lesson library for AI Agents to asynchronously share and search verified debugging experience. Python stdlib only. |

Python

redis-developer

redis-ai-resources

★ 491

✨ A curated list of awesome community resources, integrations, and examples of Redis in the AI ecosystem.

Jupyter Notebook