LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

529–552 of 3,650

shibing624

MedicalGPT

★ 5,816

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

Python

Giskard-AI

giskard-oss

★ 5,815

🐢 Open-Source Evaluation & Testing library for LLM Agents

Python

Klavis-AI

klavis

★ 5,803

Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale.

Python

PySpur-Dev

pyspur

★ 5,785

A visual playground for agentic workflows: Iterate over your agents 10x faster

TypeScript

Eventual-Inc

Daft

★ 5,769

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

Rust

areal-project

AReaL

★ 5,766

The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.

Python

generalaction

emdash

★ 5,755

Emdash is the Open-Source Agentic Development Environment (🧡 YC W26). Run multiple coding agents in parallel. Use any provider.

TypeScript

internet-court

internet-court-skill

★ 5,755

The trust layer for agent-to-agent commerce — natural-language mandates, ERC-7710 delegated permissions, x402 payments, escrow, and dispute resolution as one open, catch-all Agent Skill / Claude Code plugin.

TypeScript

mindcraft-bots

mindcraft

★ 5,752

Minecraft AI with LLMs+Mineflayer

JavaScript

memovai

mimiclaw

★ 5,751

MimiClaw: Harness on a $5 chip. No OS(Linux). No Node.js. No Mac mini. No Raspberry Pi. No VPS. Hardware agents OS.

google-deepmind

gemma

★ 5,736

Gemma open-weight LLM library, from Google DeepMind

Python

coze-dev

coze-loop

★ 5,734

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

lemonade-sdk

lemonade

★ 5,726

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

C++

truefoundry

trueforge

★ 5,705

The open-source agent harness - the runtime layer that turns an LLM into a working agent.

TypeScript

gpustack

★ 5,703

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Python

ageerle

ruoyi-ai

★ 5,700

An enterprise AI development framework for building AI agents. It provides unified management of multi-provider LLMs, secure enterprise knowledge bases with high-precision retrieval, visual workflow orchestration and multi-agent coordination. Compatible with mainstream Agent Skill standards, it enables developers to efficiently build production-gra

Java

OpenBMB

UltraRAG

★ 5,694

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

Python

huggingface

alignment-handbook

★ 5,681

Robust recipes to align language models with human and AI preferences

Python

dograh-hq

dograh

★ 5,674

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

Python

the-open-agent

openagent

★ 5,621

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

jihe520

MathModelAgent

★ 5,615

🤖📐专为数学建模设计的 Agent & skills ,自动完成数学建模，生成一份完整的可以直接提交的论文。 An Agent Designed for Mathematical Modeling ,Automatically complete mathmodel and generate a complete paper ready for submission.

Python