LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,273–1,296 of 4,628

eli64s

readme-ai

★ 2,996

README file generator, powered by AI.

Python

1Panel-dev

KubePi

★ 2,994

🚀 现代化、开源的 K8s 面板，1Panel 官方出品。

TheSmallHanCat

flow2api

★ 2,988

无限次数的banana pro！逆向账号池，支持负载均衡、AT自动刷新、缓存策略、代理等。Q交流群1073237297

Python

thu-pacman

chitu

★ 2,987

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

Python

ulab-uiuc

LLMRouter

★ 2,987

LLMRouter: An Open-Source Library for LLM Routing

Python

mazzzystar

Queryable

★ 2,986

Run OpenAI's CLIP and Apple's MobileCLIP model on iOS to search photos.

Swift

coddingtonbear

obsidian-local-rest-api

★ 2,981

A secure REST API and Model Context Protocol (MCP) server for your vault.

TypeScript

confident-ai

deepteam

★ 2,980

DeepTeam is a framework to red team LLMs and AI agents.

Python

microsoft

ResearchStudio

★ 2,976

ResearchStudio: Our AI co-author, from research problem to final publication.

Python

ogkalu2

comic-translate

★ 2,964

AI comic and manga translator app/browser extension for automatically translating comics, manga, manhwa, BDs, fumetti, and more in multiple languages and formats (Images, PDF, EPUB, CBR, CBZ etc).

Python

cloudflare

skills

★ 2,962

Skills for teaching agents how to build on Cloudflare.

Shell

open-gitagent

opengap

★ 2,957

A framework-agnostic, git-native standard for defining AI agents

TypeScript

ax-llm

ax

★ 2,956

The pretty much "official" DSPy framework for Typescript

TypeScript

jsynowiec

node-typescript-boilerplate

★ 2,956

Production-ready Node.js TypeScript boilerplate: ESM, Vitest, ESLint, Prettier, GitHub Actions, Mise, and AGENTS.md included.

TypeScript

Ryze-AI-Adgent

open-seo-mcp-skills

★ 2,956

Open-source SEO + GEO skills for Claude on your real GSC/GA4/ads data. Free MCP: claude mcp add ryze --transport http https://connector.get-ryze.ai/mcp

Shell