RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

49–72 of 596

weaviate

★ 16,814

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.

MemoriLabs

Memori

★ 16,754

Memori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured, persistent state for production systems. Built for enterprise, Memori works with the data infrastructure you already run, no rip-and-replace, and deploys across managed cloud, single-tenant cloud, VPC, and on-premises.

Python

memvid

★ 16,542

Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.

Rust

MODSetter

SurfSense

★ 16,154

Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9

Python

alibaba

zvec

★ 15,934

A lightweight, lightning-fast, in-process vector database

C++

wdndev

llm_interview_note

★ 15,105

主要记录大语言大模型（LLMs）算法（应用）工程师相关的知识及面试题

HTML

ConardLi

easy-dataset

★ 14,913

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

JavaScript

llmware-ai

llmware

★ 14,843

Unified framework for building enterprise RAG pipelines with small, specialized models

Python

datawhalechina

llm-universe

★ 13,978

本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/

Jupyter Notebook

langchain4j

★ 13,100

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Java

EverMind-AI

EverOS

★ 12,978

One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.

Python

neuml

txtai

★ 12,949

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

Python

StarTrail-org

LEANN

★ 12,940

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Python

NoFxAiOS

nofx

★ 12,911

Your AI trading terminal assistant for US stocks, commodities, forex, and crypto.

codexu

note-gen

★ 12,806

A cross-platform Markdown AI note-taking software. It is to make sure useful fragments do not disappear before you have time to turn them into something complete.

TypeScript

Orchestra-Research

AI-Research-SKILLs

★ 12,702

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.

TeX

zilliztech

claude-context

★ 12,529

Code search MCP for Claude Code. Make entire codebase the context for any coding agent.

TypeScript

ConardLi

garden-skills

★ 12,436

ConardLi's open-source Skills collection, featuring web design, knowledge retrieval, image generation, and more.

CSS

simular-ai

Agent-S

★ 12,301

Agent S: an open agentic framework that uses computers like a human

Python

FlagOpen

FlagEmbedding

★ 12,162

Retrieval and Retrieval-augmented LLMs

Python

jina-ai

reader

★ 12,000

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

TypeScript

dataelement

bisheng

★ 11,968

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Python

cocoindex-io

cocoindex

★ 11,557

Incremental engine for long horizon agents 🌟 Star if you like it!

Rust

MemTensor

MemOS

★ 11,355

Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings.

TypeScript