LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,849–1,872 of 4,627

ai4s-research

open-science

★ 1,730

Open Science Desktop — local-first, model-agnostic AI research workbench for macOS, Windows & Linux. Open-source Claude Science desktop alternative built on Tauri + MCP + agent skills.

TypeScript

supabase-community

nextjs-openai-doc-search

★ 1,729

Template for building your own custom ChatGPT style doc search powered by Next.js, OpenAI, and Supabase.

TypeScript

ddalcu

mlx-serve

★ 1,725

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

Zig

cubewhy

skid-homework

★ 1,724

Ergonomically designed, AI-powered homework solver. | 符合人体工程学设计、人工智能驱动的作业助手 | 平庸者的苦工到此为止，这是来自外星的效率补丁 (by Gemini)

TypeScript

101dotxyz

GPTeam

★ 1,723

GPTeam: An open-source multi-agent simulation

Python

amitshekhariitbhu

llm-internals

★ 1,723

Learn LLM internals step by step - from tokenization to attention to inference optimization.

getnao

nao

★ 1,723

👾 nao is an open source analytics agent. (1) Create context with nao-core cli, (2) deploy nao chat interface for everyone

TypeScript

MorDavid

BruteForceAI

★ 1,721

Advanced LLM-powered brute-force tool combining AI intelligence with automated login attacks

Python

0xSteph

pentest-ai

★ 1,719

Open-source AI pentester that proves every finding. Machine oracles re-run each exploit; verified bugs ship a proof capsule you can replay yourself.

Python

mithun50

openclaw-termux

★ 1,719

Run OpenClaw AI Gateway on Android — standalone Flutter app with built-in terminal, web dashboard, and one-tap setup. Also available as a Termux CLI package.

Dart

Continuum-AI-Corp

OrcaRouter-Lite

★ 1,717

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

Python

undreamai

LLMUnity

★ 1,717

Create characters in Unity with LLMs!

McGill-NLP

llm2vec

★ 1,716

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Python

glidea

zenfeed

★ 1,715

Make RSS 📰 great again with AI 🧠✨!! 数据打标请联系 glidea123 (数万并发随时狂飙)

LLPhant

★ 1,714

LLPhant - A comprehensive PHP Generative AI Framework using OpenAI GPT 4. Inspired by Langchain

PHP

xhongc

ai_story

★ 1,714

AI视频, AI动漫,AI 短剧,AI漫剧自动化生成工具

Python

openkursar

hello-halo

★ 1,713

7×24 Desktop AI Agent for Everyone. Visual AI assistant with remote access, file management, and built-in AI browser.

TypeScript

Tencent

WeMM-Embedding

★ 1,712

WeMM-Embedding is a family of universal multimodal embedding models by the WeChat Vision Team at Tencent, supporting multimodal understanding and retrieval.

Python