RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

505–528 of 596

run-llama

llama-agents

★ 449

Llama Agents + Workflows are an event-driven, async-first, step-based way to control the execution flow of AI applications like agents.

Python

RMA-MUN

RAGNotebook

★ 446

基于LangChain、FastAPI和React的RAG项目，主分支为基于知识图谱的知识管理平台，base-rag分支为开箱即用的基础RAG项目供学习使用

Python

Beever-AI

beever-atlas

★ 445

Your First LLM-Wiki Conversation Knowledge Base

Python

Blaizzy

mlx-embeddings

★ 443

MLX-Embeddings is the best package for running Vision and Language Embedding models locally on your Mac using MLX.

Python

umbertogriffo

rag-chatbot

★ 443

RAG (Retrieval-augmented generation) ChatBot that provides answers based on contextual information extracted from a collection of Markdown files.

Python

ratel-ai

ratel

★ 436

Context engineering for AI agents. ~80% fewer tokens. Fix tool overload. Skills and memory with in-process BM25 and semantic retrieval. Progressive Disclosure. No vector DB.

TypeScript

vintasoftware

django-ai-assistant

★ 432

Integrate AI Assistants with Django to build intelligent applications

Python

LnYo-Cly

ai4j

★ 429

Java 8+ agentic SDK: unified LLM access (OpenAI/Anthropic/DashScope/Doubao/DeepSeek...), Tool Calling, MCP, RAG, Agent Runtime, and a built-in Coding Agent CLI/TUI/ACP.

Java

redis

redis-vl-python

★ 426

Redis Vector Library. The AI-native Python client for Redis.

Python

qifan777

dive-into-spring-ai

★ 425

《动手学SpringAI》包含SSE流/Agent智能体/知识图谱RAG/FunctionCall/历史消息/图片生成/图片理解/Embedding/VectorDatabase/RAG

Java

ibrahimqureshae

mdflux

★ 422

Turn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.

Python

ageerle

ruoyi-web

★ 421

RuoYi-AI user frontend for AI conversations, agent interactions, and knowledge-base Q&A.

Vue

Laxcorp-Research

project-raven

★ 421

Open-source AI meeting copilot - real-time transcription, echo cancellation, and AI assistance. Captures system audio + mic, cancels echo via WebRTC AEC3, transcribes with Deepgram, and gives you Claude/OpenAI help during meetings. Runs locally on macOS and Windows.

TypeScript

GizClaw

flowcraft

★ 416

Production-grade Go SDK for building AI agents with long-term memory, knowledge retrieval, and voice — runnable as a library, a daemon, or a real-time pipeline.

unitagain

WenShape

★ 415

WenShape文枢(原NOVIX写作):深度上下文感知的智能体小说创作系统/A Deep Context-Aware Agent-Based Novel Creation System

Python

kimtth

azure-openai-llm-notes

★ 410

A curated collection of resources for 🌌 Azure OpenAI, 🦙 LLMs (+RAG, Agents). Monthly Updates.

Python

messkan

prompt-cache

★ 409

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

treygrainger

ai-powered-search

★ 409

The codebase for the book "AI-Powered Search" (Manning Publications, 2025) and associated "AI-Powered Search: Modern Retrieval for Humans & Agents" Maven course

Jupyter Notebook