LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,009–1,032 of 4,628

dongrixinyu

JioNLP

★ 3,872

中文 NLP 预处理、解析工具包，准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

Python

raullenchai

Rapid-MLX

★ 3,871

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.

Python

sergebulaev

linkedin-skills

★ 3,870

Claude skills for LinkedIn. 11 Claude Code and Codex skills that write human-sounding LinkedIn posts, craft comments that get noticed, analyze your feed, and build a publishing cadence, all from your terminal. Content engineering by Creative Content Crafts. MIT.

Python

isjiamu

gzh-design-skill

★ 3,865

把 Markdown 一键排成可直接粘进公众号编辑器的精致 HTML —— 6 套精选主题 + 主题生成器 + 双关卡校验。An AI-agent skill that turns Markdown into paste-ready WeChat article HTML.

HTML

NVlabs

VILA

★ 3,863

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

Python

ilysenko

codex-desktop-linux

★ 3,857

Unofficial ChatGPT desktop app for Linux (formerly the Codex app), built locally from OpenAI’s official macOS app. Includes Chat, Work, and Codex. Packages for Debian/Ubuntu (.deb), Fedora/openSUSE (.rpm), Arch (pacman), Nix/NixOS, and AppImage, with Wayland and X11 support.

JavaScript

golutra

★ 3,853

Multi-agent AI orchestration platform for automation, workflows, and developer tools. Golutra transforms Codex, Claude Code, and OpenClaw into a unified agent system with parallel execution, task orchestration, long-running workflows, and AI productivity workspace.

Rust

datawhalechina

daily-interview

★ 3,852

Datawhale成员整理的面经，内容包括机器学习，CV，NLP，推荐，开发等，欢迎大家star

gnekt

My-Brain-Is-Full-Crew

★ 3,847

Built by a PhD whose memory was failing, whose diet was a mess, and whose anxiety had its own agenda. Most second brain tools ignore the fact that your brain doesn't work in isolation: your body and your mental health are part of the system too. This crew handles all three: knowledge, nutrition, and mental wellness.

Shell

arman-bd

guppylm

★ 3,840

A ~9M parameter LLM that talks like a small fish.

Python

gadievron

raptor

★ 3,839

Raptor turns Claude Code into a general-purpose AI offensive/defensive security agent. By using Claude.md and creating rules, sub-agents, and skills, and orchestrating security tool usage, we configure the agent for adversarial thinking, and perform research or attack/defense operations.

Python

vllm-project

llm-compressor

★ 3,838

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

Python

yvgude

lean-ctx

★ 3,835

Control what your AI can see. LeanCTX (Lean Context) is the context intelligence layer for AI agents, one local Rust binary that decides what they read, remembers what they learn, guards what they touch, and proves what they save. 60 90% fewer tokens as the receipt. 76 MCP tools, 30+ agents, local-first.

Rust

HKUDS

Paper2Slides

★ 3,834

"Paper2Slides: From Paper to Presentation in One Click"

Python

predibase

lorax

★ 3,834

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Python

TracecatHQ

tracecat

★ 3,819

Open-source security automation platform for teams and AI agents

Python

CookSleep

gpt_image_playground

★ 3,818

基于 OpenAI gpt-image-2.5 API 的图片生成与编辑工具

TypeScript

aiming-lab

SimpleMem

★ 3,816

SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

Python

Atmosphere

atmosphere

★ 3,815

Portable AI agent runtime for the JVM. One @Agent class runs on Spring AI, LangChain4j, Anthropic, or 9 more behind one SPI. Token streaming, tool calls, human approvals, and governance over WebSocket, SSE, gRPC, or WebTransport/HTTP3. Speaks MCP, A2A, and AG-UI.

Java

SciSharp

LLamaSharp

★ 3,807

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

tbxark

ChatGPT-Telegram-Workers

★ 3,804

Easily deploy your Telegram ChatGPT bot on Cloudflare Workers (or Vercel, Docker...).

TypeScript

1186258278

OpenClawChineseTranslation

★ 3,800

JavaScript

didi

xiaoju-survey

★ 3,798

XIAOJUSURVEY is an enterprises form builder and analytics platform that allows users to create questionnaires, exams, polls, quizzes, and analyze data online.

TypeScript

Limine-Bootloader

Limine

★ 3,795

Modern, secure, portable, multiprotocol bootloader and boot manager.