RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

25–48 of 639

getzep

graphiti

★ 31,078

Build Real-Time Knowledge Graphs for AI Agents

Python

labring

FastGPT

★ 29,770

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

TypeScript

simstudioai

sim

★ 29,721

Build, deploy, and orchestrate AI agents. Sim is the central intelligence layer for your AI workforce.

TypeScript

NirDiamant

RAG_Techniques

★ 29,631

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed notebook tutorial.

Jupyter Notebook

deepset-ai

haystack

★ 26,615

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

Python

apify

crawlee

★ 25,821

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

TypeScript

Cinnamon

kotaemon

★ 25,769

An open-source RAG-based tool for chatting with your documents.

Python

promptfoo

★ 25,458

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

TypeScript

NirDiamant

GenAI_Agents

★ 24,316

50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.

Jupyter Notebook

AccumulateMore

CV

★ 23,737

✅（已完结）超级全面的深度学习笔记【土堆 Pytorch】【李沐动手学深度学习】【吴恩达深度学习】【大飞大模型Agent】

Jupyter Notebook

HKUDS

RAG-Anything

★ 23,458

"RAG-Anything: All-in-One RAG Framework"

Python

1Panel-dev

MaxKB

★ 22,877

MaxKB is an open-source platform for building enterprise-grade agents. .

Python

comet-ml

opik

★ 22,288

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Python

PromtEngineer

localGPT

★ 22,199

Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.

Python

coze-dev

coze-studio

★ 21,654

An AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before. Coze your way to AI Agent creation.

TypeScript

NirDiamant

agents-towards-production

★ 21,508

End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.

Jupyter Notebook

liyupi

ai-guide

★ 20,587

程序员鱼皮的 AI 资源大全 + Vibe Coding 零基础教程，分享 OpenClaw 保姆级教程、大模型玩法（DeepSeek / GPT / Gemini / Claude / GLM）、最新 AI 资讯、Prompt 提示词大全、AI 知识百科（Agent Skills / RAG / MCP / A2A）、AI 编程教程（Harness Engineering）、AI 工具用法（Cursor / Claude Code / TRAE / Codex / Copilot）、AI 开发框架教程（Spring AI / LangChain）、AI 产品变现指南，帮你快速掌握 AI 技术，走在时代前沿。本项目为开源文档 aiguide，已升级为鱼皮 AI 导航网站

JavaScript

nashsu

llm_wiki

★ 20,079

LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratch every time), the LLM incrementally builds and maintains a persistent wiki from your sources。

TypeScript

eosphoros-ai

DB-GPT

★ 20,067

open-source agentic AI data assistant for the next generation of AI + Data products.

Python

elizaOS

eliza

★ 19,509

Open source agentic operating system. Apps on elizaOS elizaOS runs apps, not just an agent.

TypeScript

stas00

ml-engineering

★ 19,062

Machine Learning Engineering Open Book

Python

metainternal

llama-cookbook

★ 18,557

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Jupyter Notebook

arc53

DocsGPT

★ 18,271

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Python

langbot-app

LangBot

★ 17,976

Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow

Python