RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

361–384 of 596

llama-farm

llamafarm

★ 838

Deploy any AI model, agent, database, RAG, and pipeline locally or remotely in minutes

Python

Nebius-Academy

LLM-Engineering-Essentials

★ 836

Materials for the LLM Engineering Essentials course

Jupyter Notebook

jegly

Box

★ 834

The most advanced, fully offline client-side AI suite on Android today.

Kotlin

varunvasudeva1

llm-server-docs

★ 833

End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.

ChuckHend

pg_vectorize

★ 832

Full-text and semantic search on any Postgres

Rust

huangjia2019

rag-in-action

★ 831

End-to-end RAG system design, evaluation, and optimization. 极客时间RAG训练营，RAG 10大组件全面拆解，4个实操项目吃透 RAG 全流程。RAG的落地，往往是面向业务做RAG，而不是反过来面向RAG做业务。这就是为什么我们需要针对不同场景、不同问题做针对性的调整、优化和定制化。魔鬼全在细节中，我们深入进去探究。

Jupyter Notebook

ZeroZ-lab

cc-design

★ 831

High-fidelity HTML design and prototype guidance skill for AI agents

JavaScript

kytmanov

obsidian-llm-wiki-local

★ 824

Karpathy’s LLM Wiki, 100% local with Ollama. Drop Markdown notes → AI extracts concepts → your Obsidian wiki auto-links and grows. Zero sharing. Your notes stay yours.

Python

HKUST-KnowComp

AutoSchemaKG

★ 819

This repository contains the implementation of AutoSchemaKG, a novel framework for automatic knowledge graph construction that combines schema generation via conceptualization.

Python

verygoodplugins

automem

★ 810

Long-term memory for AI assistants. Graph + vector store that recalls decisions, relationships, and context across sessions.

Python

helixml

helix

★ 809

♾️ Private Agent Fleet with Spec Coding. Each agent gets their own GPU-accelerated desktop. Run Claude, Codex, Gemini and open models on a full private AI Stack ♾️

Haohao-end

openagent

★ 808

What if OpenAI Deep Research and Dify were one platform? OpenAgent — harness architecture for rapidly building vertical AI agents, with deep reasoning loops, visual workflows, RAG, and A2A delegation.

Python

proinsight-io

crewmeld

★ 804

CrewMeld — Enterprise AI Digital Workforce Platform. Manage AI employees like real team members. Visual SOP orchestration, 13 LLM providers (including China-native models), 8+ messaging channels(WeCom/DingTalk/Feishu/Telegram), knowledge base with RAG, and full private deployment support. Built with Next.js, React, TypeScript & Bun.

TypeScript

christopherkarani

Wax

★ 797

Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift

Swift

ShaikhWarsi

free-ai-tools

★ 788

Curated list of free and low cost AI tools, LLM APIs, IDEs, agents, and infrastructure for building real AI apps

TypeScript

DeepXiv

deepxiv_sdk

★ 783

Talk to research papers like talking to authors - Python package with AI agent for arXiv papers

Python

bosun-ai

swiftide

★ 781

Fast, streaming indexing, query, and agentic LLM applications in Rust

Rust

ThomasVitale

llm-apps-java-spring-ai

★ 780

Samples showing how to build Java applications powered by Generative AI and LLMs using Spring AI and Spring Boot.

Java

IntelLabs

RAG-FiT

★ 768

Framework for enhancing LLMs for RAG tasks using fine-tuning.

Python

NVIDIA-AI-Blueprints

rag

★ 766

This NVIDIA RAG blueprint serves as a reference solution for a foundational Retrieval Augmented Generation (RAG) pipeline.

Python

guoguo-tju

agent_java_offer

★ 764

公开的 Java 后端 / AI Agent / 系统设计 / 算法面试复习资料库

jonfairbanks

local-rag

★ 759

Ingest files for retrieval augmented generation (RAG) with open-source Large Language Models (LLMs), all without 3rd parties or sensitive data leaving your network.

Python

MigoXLab

dingo

★ 756

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

Python

archie0732

healthy-diet-ai-agent

★ 754

Healthy Diet AI Agent is a Bun + TypeScript backend for nutrition chat, food-image analysis, RAG document ingestion, and knowledge-grounded diet guidance.

TypeScript