LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

745–768 of 3,650

LazyAGI

LazyLLM

★ 3,886

Easiest and laziest way for building multi-agent LLMs applications.

Python

snap-stanford

Biomni

★ 3,883

Biomni: a general-purpose biomedical AI agent

Python

dongrixinyu

JioNLP

★ 3,868

中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

Python

EverMind-AI

Raven

★ 3,858

The memory-first, self-improving agent harness built on EverOS, with MiroThinker-powered deep research and reasoning.

Python

golutra

★ 3,844

Multi-agent AI orchestration platform for automation, workflows, and developer tools. Golutra transforms Codex, Claude Code, and OpenClaw into a unified agent system with parallel execution, task orchestration, long-running workflows, and AI productivity workspace.

Rust

CherryHQ

cherry-studio-app

★ 3,840

🍒 This is the mobile version of Cherry Studio.

TypeScript

predibase

lorax

★ 3,832

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Python

datawhalechina

daily-interview

★ 3,827

Datawhale成员整理的面经，内容包括机器学习，CV，NLP，推荐，开发等，欢迎大家star

ilysenko

codex-desktop-linux

★ 3,822

Unofficial ChatGPT desktop app for Linux (formerly the Codex app), built locally from OpenAI’s official macOS app. Includes Chat, Work, and Codex. Packages for Debian/Ubuntu (.deb), Fedora/openSUSE (.rpm), Arch (pacman), Nix/NixOS, and AppImage, with Wayland and X11 support.

JavaScript

openai

openai-agents-js

★ 3,822

A lightweight, powerful framework for multi-agent workflows and voice agents

TypeScript

xiaobright

dsh-anchored-standard

★ 3,816

Two-phase DeepSeek Harness preset: Minimal-aligned bootstrap, then full Standard tools (Project2 98/99)

JavaScript

Atmosphere

atmosphere

★ 3,812

Portable AI agent runtime for the JVM. One @Agent class runs on Spring AI, LangChain4j, Anthropic, or 9 more behind one SPI. Token streaming, tool calls, human approvals, and governance over WebSocket, SSE, gRPC, or WebTransport/HTTP3. Speaks MCP, A2A, and AG-UI.

Java

nowork-studio

notfair-plugin

★ 3,809

Open-source SEO, GEO, and marketing skills for AI agents.

TypeScript

TracecatHQ

tracecat

★ 3,804

Open-source security automation platform for teams and AI agents

Python

tbxark

ChatGPT-Telegram-Workers

★ 3,803

Easily deploy your Telegram ChatGPT bot on Cloudflare Workers (or Vercel, Docker...).

TypeScript

1186258278

OpenClawChineseTranslation

★ 3,799

JavaScript

didi

xiaoju-survey

★ 3,797

XIAOJUSURVEY is an enterprises form builder and analytics platform that allows users to create questionnaires, exams, polls, quizzes, and analyze data online.

TypeScript

SciSharp

LLamaSharp

★ 3,797

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

gofireflyio

aiac

★ 3,789

Artificial Intelligence Infrastructure-as-Code Generator.

vllm-project

llm-compressor

★ 3,789

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Python

askrella

whatsapp-chatgpt

★ 3,785

ChatGPT + DALL-E + WhatsApp = AI Assistant :rocket: :robot:

TypeScript

yvgude

lean-ctx

★ 3,781

Control what your AI can see. LeanCTX (Lean Context) is the context intelligence layer for AI agents, one local Rust binary that decides what they read, remembers what they learn, guards what they touch, and proves what they save. 60 90% fewer tokens as the receipt. 76 MCP tools, 30+ agents, local-first.

Rust

raullenchai

Rapid-MLX

★ 3,763

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.

Python

aiming-lab

SimpleMem

★ 3,762

SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

Python