English
简体中文繁體中文English日本語DeutschFrançais
AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,393–1,416 of 3,650
★ 1,694

Ergonomically designed, AI-powered homework solver. | 符合人体工程学设计、人工智能驱动的作业助手 | 平庸者的苦工到此为止，这是来自外星的效率补丁 (by Gemini)

TypeScript
relaticle

relaticle

★ 1,682

Open-source CRM with native AI agent support. 37 MCP tools, REST API, self-hosted. Built with Laravel & Filament

PHP
kwaroran

Risuai

★ 1,681

Make your own story. User-friendly software for LLM roleplaying

TypeScript
lotus-data

lotus

★ 1,681

Optimized Agentic and LLM Bulk Processing Over Your Data

Python
0xSteph

pentest-ai

★ 1,678

Open-source AI pentester that proves every finding. Machine oracles re-run each exploit; verified bugs ship a proof capsule you can replay yourself.

Python
Kuddev

pebrel

★ 1,676

AI-native, GPU-accelerated terminal emulator for Windows with SSH, persistent sessions, split panes, and first-class AI CLI workflows.

Rust
★ 1,676

Universal motion design principles for AI agents — timing, easing, choreography, and Disney animation principles adapted for UI

SemiAnalysisAI

InferenceX

★ 1,676

Open Source Continuous Inference Benchmark Research Platform, Kimi K2.7-Code, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon TPUv6e/v7/Trainium2/3 | , Kimi K2.7-Code MiniMax M3 DeepSeekv4 GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 TPUv6e/v7/Trainium2/3.

Python
happier-dev

happier

★ 1,675

Web, Desktop & Mobile client for Codex, Claude Code, OpenCode, Kimi, Augment Code, Qwen, fully end-to-end encrypted

TypeScript
skyllwt

AutoSci

★ 1,674

Karpathy's LLM-Wiki vision, fully realized — wiki-centric full-lifecycle AI research platform powered by Claude Code

Python
gi-dellav

zerostack

★ 1,673

Lightweight coding agent written in Rust, optimized for memory footprint and performance

Rust
tenstorrent

tt-metal

★ 1,673

TT-NN operator library, and TT-Metalium low level kernel programming model.

C++
intentee

paddler

★ 1,672

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Rust
bytedance

Sa2VA

★ 1,671

Official Repo For Pixel-LLM Codebase: Sa2VA (T-PAMI-26), SAMTok (CVPR-26), VRT (Arxiv-25), SaSaSa2VA (1-st solution for LSVOS)

Python
Gitlawb

zero

★ 1,671

The coding agent that answers to you, your model, your machine, your rules.

Go
AgentR1

Agent-R1

★ 1,669

Agent-R1: Training Powerful LLM Agents with End-to-End Reinforcement Learning

Python
devenjarvis

lathe

★ 1,668

Generate hands-on, multi-part technical tutorials on demand, with LLM skills tuned to make content approachable. Then you work through them yourself, by hand ✋

Go
deepsense-ai

ragbits

★ 1,667

Building blocks for rapid development of GenAI applications

Python
PurpleDoubleD

locally-uncensored

★ 1,667

The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Windows and Linux. No Docker, no terminal, no cloud required.

TypeScript
★ 1,665

A project-based course repository for developing AI agents using LangChain v1+ and LangGraph: search agents, RAG systems, reflection agents, and code interpreters.

FrigadeHQ

trench

★ 1,663

Trench — Open-Source Analytics Infrastructure. A single production-ready Docker image built on ClickHouse, Kafka, and Node.js for tracking events. Easily build product analytics dashboards, LLM RAGs, observability platforms, or any other analytics product.

TypeScript
ghostwright

ghost-os

★ 1,661

Full computer-use for AI agents. Self-learning workflows. Native macOS. No screenshots required.

Swift