LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

769–792 of 4,628

looplj

axonhub

★ 5,323

⚡️ Open-source AI Gateway — Use any SDK to call 100+ LLMs. Built-in failover, load balancing, cost control & end-to-end tracing.

FunnyWolf

Viper

★ 5,319

Adversary simulation and Red teaming platform with AI

88lin

video_vip

★ 5,316

全网VIP视频免费破解脚本，通过集成多个第三方解析接口，去除广告，解锁视频网站的会员限制，让用户享受免费的视频观看体验。适配PC+移动，支持爱奇艺、腾讯、优酷、芒果TV、bilibili等主流视频平台！脚本长期维护更新，完全免费

JavaScript

neo4j-labs

llm-graph-builder

★ 5,274

Neo4j graph construction from unstructured data using LLMs

Jupyter Notebook

gz-yami

mall4j

★ 5,264

⭐️⭐️⭐️ 电商商城小程序电商商城系统 PC商城 H5商城 APP商城 Java商城 O2O商城跨境商城

JavaScript

ArcReel

★ 5,259

AI Agent 驱动的开源可自部署视频工作台：将小说与剧本转为角色、场景、道具资产、分镜、视频和剪映草稿，支持跨镜头一致性、多供应商与费用追踪 | Self-hosted AI video workspace for stories, storyboards and short-form video production

Python

FailproofAI

failproofai

★ 5,236

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement. 40 built-in policies, a local dashboard, no account required with a generous free cloud plan

MDX

jina-ai

node-DeepResearch

★ 5,234

Keep searching, reading webpages, reasoning until it finds the answer (or exceeding the token budget)

TypeScript

xingkongliang

skills-manager

★ 5,231

A lightweight desktop app to manage, sync, and organize AI agent skills across 50+ coding tools — Claude Code, Codex, Cursor, Copilot, Gemini CLI, and more.

Rust

shareAI-lab

Kode-CLI

★ 5,230

Kode CLI — Design for post-human workflows. One unit agent for every human & computer task.

TypeScript

katanaml

sparrow

★ 5,227

Structured data extraction, instruction calling and agentic workflows with ML, LLM and Vision LLM

Python

Orillusion

orillusion

★ 5,220

Orillusion is a pure Web3D rendering engine which is fully developed based on the WebGPU standard.

TypeScript

camel-ai

oasis

★ 5,218

🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.

Python

su-kaka

gcli2api

★ 5,218

将 GeminiCLI 和 Antigravity 转换为 OpenAI 、GEMINI 和 Claude API 接口

Python

awarexone

Agentic-Bug-Hunter

★ 5,216

AI-powered bug bounty hunting toolkit that works with or without subscription.

Python

InternLM

xtuner

★ 5,206

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Python

sgl-project

mini-sglang

★ 5,204

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Python

SaladDay

cc-switch-cli

★ 5,201

⭐️ A cross-platform CLI All-in-One assistant tool for Claude Code, Codex & Gemini CLI.

Rust

openai

parameter-golf

★ 5,198

Train the smallest LM you can that fits in 16MB. Best model wins!

Python

linuxhsj

openclaw-zero-token

★ 5,197

OpenClaw: Use All Major AI Models NO API Token! Claude/ChatGPT/Gemini/DeepSeek/Doubao/Grok/Qwen/Manus/Kimi

TypeScript

Anil-matcha

AI-Youtube-Shorts-Generator

★ 5,196

Open-source alternative to Opus Clip, Vidyo.ai, Klap & SubMagic. Turn long-form YouTube videos into viral 9:16 shorts using LLM highlight detection, Whisper transcription, and auto vertical cropping — free, no watermarks, no per-clip credits.

Python