LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,801–1,824 of 4,627

beam-cloud

beta9

★ 1,800

Ultrafast serverless GPU inference, sandboxes, and background jobs

vllm-project

vllm-metal

★ 1,800

Community maintained hardware plugin for vLLM on Apple Silicon

Python

delibae

claude-prism

★ 1,797

An offline-first scientific writing workspace powered by Claude. LaTeX + Python + 100+ scientific skills all running locally.

TypeScript

elizabetht

100-days-of-inference

★ 1,797

100 days of LLM inference engineering — daily posts, experiments, and visualizations

Jupyter Notebook

littledivy

mimic

★ 1,797

Intercept any app, then call it from Python like a library

Python

happier-dev

happier

★ 1,796

Web, Desktop & Mobile client for Codex, Claude Code, OpenCode, Kimi, Augment Code, Qwen, fully end-to-end encrypted

TypeScript

ginlix-ai

LangAlpha

★ 1,795

Claude Code for Financial Market

Python

standardagents

dmux

★ 1,792

A dev agent multiplexer for git worktrees and coding agents.

HTML

Barca0412

Introduction-to-Quantitative-Finance

★ 1,791

AI+金融（量化）：1.多因子股票量化框架开源教程 2.学界和业界的经典资料收录 3.AI + 金融的相关工作，包括LLM, Agent, benchmark(evaluation), etc.

Python

NVIDIA-NeMo

Curator

★ 1,791

Scalable data pre processing and curation toolkit for LLMs

Python

onestardao

WFGY

★ 1,791

WFGY is heading toward WFGY 5.0 Polaris Protocol, a major open-source release for AI reasoning, RAG, agents, and real-world workflows. Includes Problem Map, Global Debug Card, WFGY 4.0, and the CFV Easter Egg.

Jupyter Notebook

he-yufeng

CoreCoder

★ 1,790

Minimal AI coding agent (~1,000 lines of Python) inspired by Claude Code. Works with any LLM. Think NanoGPT for coding agents. Formerly NanoCoder.

Python

SmartFlowAI

EmoLLM

★ 1,790

心理健康大模型 (LLM x Mental Health), Pre & Post-training & Dataset & Evaluation & Depoly & RAG, with InternLM / Qwen / Baichuan / DeepSeek / Mixtral / LLama / GLM series models

Python

0xSero

turboquant

★ 1,788

TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration

Python

High-Logic

Genie-TTS

★ 1,786

GPT-SoVITS ONNX Inference Engine & Model Converter

Python

lmstudio-ai

lmstudio-js

★ 1,785

LM Studio TypeScript SDK

TypeScript

neuml

paperai

★ 1,785

📄 🤖 AI for medical and scientific papers

Python

a2aproject

a2a-samples

★ 1,784

Samples using the Agent2Agent (A2A) Protocol

Jupyter Notebook

hyperfield

ai-file-sorter

★ 1,782

Cross-platform desktop application for content-aware file organization and renaming. Supports local and remote LLMs, preview-based workflows, and fully user-controlled changes.

C++