LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

793–816 of 4,628

salesforce

CodeGen

★ 5,183

CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.

Python

h2oai

h2o-llmstudio

★ 5,182

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Python

Waishnav

devspace

★ 5,180

Minimal Coding Agent Harness on MCP for ChatGPT, Claude, Hermes, Grok Bot, OpenClaw

TypeScript

hiyouga

EasyR1

★ 5,179

EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL

Python

udacity

deep-reinforcement-learning

★ 5,175

Repo for the Deep Reinforcement Learning Nanodegree program

Jupyter Notebook

dmMaze

BallonsTranslator

★ 5,173

深度学习辅助漫画翻译工具, 支持一键机翻和简单的图像/文本编辑 | Yet another computer-aided comic/manga translation tool powered by deeplearning

Python

eooce

Sing-box

★ 5,147

既然来了，就留下你的Star吧！Serv00 | CT8 | Hostuno | VPS | 游戏机 | sing-box(reality + hy2 + vmess-argo +tuic5)四合一无交互一键安装脚本(已适配Alpine)，支持纯V6 vps，丰富的分流服务, 可添加anytls,socks5,ss-2022等协议

Shell

bikini

exploitarium

★ 5,144

A single archive of public exploit PoCs and vulnerability research writeups. At the time I post these, none have been reported. Feel free to report them yourself and take credit for the CVE if handed out lulz. Please do not abuse these. I do this so to allure people into the field, and I've always found this is the most efficient way.

Python

entireio

cli

★ 5,144

📜 Entire CLI hooks into your Git workflow to capture AI agent sessions as you work. Sessions are indexed alongside commits, creating a searchable record of how code was written in your repo.

jinwyp

one_click_script

★ 5,143

install latest or LTS linux kernel and enable BBR or BBR plus

Shell

Kiln-AI

Kiln

★ 5,143

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Python

argilla-io

argilla

★ 5,128

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets.

Python

mangiucugna

json_repair

★ 5,118

Repair malformed JSON from LLMs, APIs, logs, and user input in Python.

Python

Marker-Inc-Korea

AutoRAG

★ 5,110

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

TypeScript

tencentmusic

supersonic

★ 5,109

SuperSonic is the next-generation AI+BI platform that unifies Chat BI (powered by LLM) and Headless BI (powered by semantic layer) paradigms.

Java

TabularisDB

tabularis

★ 5,097

Open-source desktop SQL workspace for PostgreSQL, MySQL/MariaDB, SQLite and 15+ more databases like DuckDB, ClickHouse, Redis and Firestore. Built-in MCP server for Claude, Cursor and Devin, SQL notebooks and visual EXPLAIN.

TypeScript

iflow-ai

iflow-cli

★ 5,091

iFlow cli is a comprehensive command-line intelligence that embeds in your terminal, analyzes your repositories, does coding tasks, interprets your needs across contexts, and boosts efficiency by performing tasks from simple file operations to complex workflow automation.

Shell

icip-cas

PPTAgent

★ 5,079

An Agentic Framework for Reflective PowerPoint Generation

Python

exa-labs

exa-mcp-server

★ 5,070

Exa MCP for web search and web crawling!

TypeScript

huggingface

text-embeddings-inference

★ 5,066

A blazing fast inference solution for text embeddings models

Rust

SamurAIGPT

Generative-Media-Skills

★ 5,066

Multi-modal Generative Media Skills for AI Agents (Claude Code, Cursor, Gemini CLI). High-quality image, video, and audio generation powered by muapi.ai.

Shell