dify
Dify is an open-source LLM app platform combining agentic workflows, RAG pipelines and model management, deployable on cloud, VPC, or self-hosted infrastructure.
Retrieval-augmented generation (RAG) makes a language model answer from your own documents. The text is split into chunks, turned into vectors and stored in an index, and the most relevant chunks are added to the prompt when a question comes in. The projects here cover the whole pipeline or one part of it: document parsing, vector search, or a complete question-answering app.
Answer quality in RAG depends mostly on retrieval, not on the model. Compare how each project handles difficult documents such as PDFs, tables and scans, whether it supports hybrid search that combines keywords with vectors and re-ranking, and whether it shows which sources an answer came from.
Dify is an open-source LLM app platform combining agentic workflows, RAG pipelines and model management, deployable on cloud, VPC, or self-hosted infrastructure.
LangChain gives agent builders a common layer for models, tools, retrieval, and multi-step execution.
Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.
Persistent Context Across Sessions for Every Agent, Captures everything your agent does during sessions, compresses it with AI, and injects relevant context back into future sessions. Works with Claude Code, OpenClaw, Codex, Gemini, Hermes, Copilot, OpenCode + More.
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses reliable RAG with Agent capabilities to create a superior context layer for LLMs.
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.
Local-first, all-in-one AI desktop app for chatting with your documents and running AI agents, with multi-user support and no setup friction.
Mem0 stores and retrieves user, session, and agent memories so AI applications can carry preferences and context across conversations.
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. Docker-friendly.Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.
A framework for building document agents and retrieval applications.
Milvus is a cloud-native vector database in Go and C++ for scalable ANN search over billions of vectors, with CPU/GPU acceleration and real-time streaming updates.
[EMNLP2025] "LightRAG: Simple and Fast Retrieval-Augmented Generation.
In-depth tutorials on LLMs, RAGs and real-world AI agent applications.
Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
PageIndex: Document Index for Vectorless, Reasoning-based RAG. Inspired by AlphaGo, we propose **PageIndex**, a **vectorless**, **reasoning-based RAG** system that builds a **hierarchical tree index** from long documents, and uses LLMs to **reason** *over that index* for **agentic, context-aware retrieval**.
2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.
Open Source AI Platform - AI Chat with advanced features that works with every LLM
Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.
Python scraper based on AI
Build Real-Time Knowledge Graphs for AI Agents
Cognee is the open-source AI memory platform for agents. Give your AI agents persistent long-term memory across sessions with a self-hosted knowledge graph engine.