LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

865–888 of 3,650

Snailclimb

interview-guide

★ 3,243

基于 Spring Boot 4.1、Java 25、Spring AI 2.0、React、PostgreSQL/pgvector、Redis 和 RustFS 构建的开源 AI 面试平台，支持简历智能分析、模拟面试、语音面试和知识库 RAG。

Java

llm-as-a-verifier

★ 3,234

LLM-as-a-Verifier is a general-purpose framework that provides fine-grained feedback for any agent without requiring additional training. It achieves SOTA performance across coding, robotics, and medical agentic benchmarks.

Python

alexrudall

ruby-openai

★ 3,223

OpenAI API + Ruby! 🤖❤️ GPT-5 & Realtime WebRTC compatible!

Ruby

MemMachine

★ 3,221

Universal memory layer for AI Agents. It provides scalable, extensible, and interoperable memory storage and retrieval to streamline AI agent state management for next-generation autonomous systems.

Python

harbor

★ 3,219

Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.

Python

Josh-XT

AGiXT

★ 3,215

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Python

liaohch3

claude-tap

★ 3,206

Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer.

Python

qdrant

fastembed

★ 3,203

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Python

mayneyao

eidos

★ 3,187

A single-file relational spreadsheet for you and your agent.

TypeScript

smartloli

EFAK

★ 3,181

A AI-Driven, Distributed and high-performance monitoring system, for comprehensive monitoring and management of kafka cluster.

Java

taylorwilsdon

google_workspace_mcp

★ 3,176

Control Gmail, Google Calendar, Docs, Sheets, Slides, Chat, Forms, Tasks, Search & Drive with AI - Comprehensive Google Workspace MCP Server & CLI Tool

Python

SkyworkAI

Skywork-R1V

★ 3,171

Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.

Python

dosco

graphjin

★ 3,167

One governed graph for AI agents, GraphQL + MCP over your databases, files, APIs, and code.

langchain-ai

agent-chat-ui

★ 3,161

🦜💬 Web app for interacting with any LangGraph agent (PY & TS) via a chat interface.

TypeScript

blazickjp

arxiv-mcp-server

★ 3,159

A local MCP server for agent literature work. Original-LaTeX section reads, BibTeX from arXiv metadata, and topic watches. Papers stay on disk. Search is optional.

Python