RAG

Open-source RAG frameworks

Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.

How to choose

Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.

Most-starred projects

265–288 of 596

AnalyseDeCircuit

oxideterm

★ 1,557

AI-native workspace for local shells and remote machines.Zero Webview, zero OpenSSL, zero telemetry, and no app subscription.

Rust

amitshekhariitbhu

llm-internals

★ 1,554

Learn LLM internals step by step - from tokenization to attention to inference optimization.

GitHamza0206

simba

★ 1,540

OpenSource Production ready Customer service with built in Evals and monitoring

TypeScript

fim-ai

fim-one

★ 1,508

Open-source agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.

Python

aws-samples

amazon-bedrock-samples

★ 1,505

This repository contains examples for customers to get started using the Amazon Bedrock Service. This contains examples for all available foundational models

Jupyter Notebook

import-ai

omnibox

★ 1,487

Collect, organize, use, and share, all in OmniBox.

Python

DEEIX-AI

DEEIX-Chat

★ 1,464

An enterprise AI workspace for model routing, multimodal chat, files, tools, billing, identity, and operations.

ModelEngine-Group

app-platform

★ 1,457

AppPlatform 是一个前沿的大模型应用工程，旨在通过集成的声明式编程和低代码配置工具，简化和优化大模型的训练与推理应用的开发过程。本工程为软件工程师和产品经理提供一个强大的、可扩展的环境，以支持从概念到部署的全流程 AI 应用开发。

Java

writer

writer-framework

★ 1,449

No-code in the front, Python in the back. An open-source framework for creating data apps.

Python

Ramakm

ai-hands-on

★ 1,444

A group of notebooks and other files which can help you learn AI from scratch.

Jupyter Notebook

nduckmink

arkon

★ 1,441

Arkon: Enterprise AI Knowledge Hub & MCP Server. Self-hosted knowledge base for teams to manage RAG contexts, access policies, and AI skills. Connect Claude and other LLMs via Model Context Protocol (MCP) for automated, secure organizational knowledge integration.

Python

chunkhound

★ 1,431

Your entire engineering context, deeply understood

Python

Vincentwei1021

anything2explainer

★ 1,409

Topic in, narrated explainer video out. A Claude Code / Codex skill that turns any topic into a black-canvas motion-graphics explainer video with TTS voiceover, subtitles and a chapter progress bar. Chinese or English; every frame drawn in code with Remotion.

TypeScript

sajal2692

data-science-portfolio

★ 1,401

Portfolio of data science projects completed by me for academic, self learning, and hobby purposes.

Jupyter Notebook

aws-samples

aws-genai-llm-chatbot

★ 1,400

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

TypeScript

aws-samples

generative-ai-use-cases

★ 1,385

Application implementation with business use cases for safely utilizing generative AI in business operations

TypeScript

cv-cat

XianYuApis

★ 1,377

闲鱼算法逆向，闲鱼api，websockets自动运营，咸鱼AI Agent基座

JavaScript

moyangzhan

langchain4j-aideepin

★ 1,370

基于AI的工作效率提升工具（聊天、绘画、知识库、工作流、 MCP服务市场、语音输入输出、长期记忆） | Ai-based productivity tools (Chat,Draw,RAG,Workflow,MCP marketplace, ASR,TTS, Long-term memory etc)

Java

ClaudioDrews

memory-os

★ 1,360

A 7-layer memory operating system for Hermes Agent — persistent memory with Qdrant, structured facts, fabric recall, auto-curated wiki, and surgical context injection. Runs locally, any LLM provider.

Python

Dataojitori

nocturne_memory

★ 1,355

A lightweight, rollbackable, and visual Long-Term Memory Server for MCP Agents. Say goodbye to Vector RAG and amnesia. Empower your AI with persistent, graph-like structured memory across any model, session, or tool. Drop-in replacement for OpenClaw.

Python