LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

241–264 of 3,650

siteboon

claudecodeui

★ 13,700

Use Claude Code, OpenCode, Cursor CLI, and Codex on mobile and web with CloudCLI (aka Claude Code UI). CloudCLI is a free open source webui/GUI that helps you manage your Claude Code session and projects remotely.

TypeScript

browseros-ai

BrowserOS

★ 13,677

🌐 The open-source Agentic browser; alternative to ChatGPT Atlas, Perplexity Comet, Dia.

TypeScript

Lightning-AI

litgpt

★ 13,665

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python

microsoft

agent-framework

★ 13,533

A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.

Python

xszyou

Fay

★ 13,528

fay是一个帮助数字人（2.5d、3d、移动、pc、网页）或大语言模型（openai兼容、deepseek）连通业务系统的agent框架。

Python

doocs

md

★ 13,330

✍ WeChat Markdown Editor | 一款高度简洁的微信 Markdown 编辑器：支持 Markdown 语法、自定义主题样式、内容管理、多图床、AI 助手等特性

TypeScript

halfrost

Halfrost-Field

★ 13,236

✍🏻 Source Code Deep Dives, System Design & Engineering Blogs | Halfrost-Field 冰霜之地：源码解析、系统设计与工程实践笔记

langchain4j

★ 13,100

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Java

cloudwego

eino

★ 13,059

The ultimate LLM/AI application development framework in Go.

ShishirPatil

gorilla

★ 13,023

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

Python

nidhinjs

prompt-master

★ 13,011

A Claude skill that writes the accurate prompts for any AI tool. Zero tokens or credits wasted. Full context and memory retention

The-PR-Agent

pr-agent

★ 13,002

🚀 PR Agent: The Original Open-Source PR Reviewer. This project is not the Qodo free tier.

Python

Portkey-AI

gateway

★ 13,000

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

TypeScript

EverMind-AI

EverOS

★ 12,978

One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.

Python

PaddlePaddle

PaddleNLP

★ 12,972

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Python

neuml

txtai

★ 12,949

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

Python

StarTrail-org

LEANN

★ 12,940

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Python

codexu

note-gen

★ 12,806

A cross-platform Markdown AI note-taking software. It is to make sure useful fragments do not disappear before you have time to turn them into something complete.

TypeScript

Orchestra-Research

AI-Research-SKILLs

★ 12,702

Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.

TeX