LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,489–1,512 of 4,628

hydropix

TranslateBooksWithLLMs

★ 2,452

Translate full-length books and documents with Ollama, OpenAI-compatible, Gemini, Mistral, DeepSeek, Poe or OpenRouter. Preserves formatting. Resumes where you left off. No file size limits.

Python

metarank

★ 2,447

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

Scala

milvus-io

bootcamp

★ 2,446

Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.

Jupyter Notebook

TorchIO-project

torchio

★ 2,446

Medical imaging processing for AI applications.

Python

FullAgent

fulling

★ 2,445

Fulling is an AI-powered Full-stack Engineer Agent. Built with Next.js, Claude, shadcn/ui, and PostgreSQL. Use kubernetes as infra.

TypeScript

ggozad

oterm

★ 2,445

the terminal client for LLMs

Python

she-llac

claude-counter

★ 2,445

A minimal browser extension that shows token count, cache timer, and usage bars on claude.ai.

JavaScript

hitsz-ids

synthetic-data-generator

★ 2,439

SDG is a specialized framework designed to generate high-quality structured tabular data.

Python

RAIT-09

obsidian-agent-client

★ 2,439

Bring AI agents into Obsidian via Agent Client Protocol (ACP), such as Claude Code, Codex and Gemini CLI.

TypeScript

Prism-Shadow

penguin-harness

★ 2,438

🐧 Harness for RSI. Let AI Build AI. Multi-Agent Auto-Dev Platform. Everything is Transparent.

TypeScript

lennney

stop-that-shit

★ 2,437

Stop That Shit（别再造史了）｜面向 Codex/GPT 场景的多平台 Hook + Skill Guard：拦截 AI coding agent 无需求的哈希、校验和与任务范围膨胀。 A multi-platform Hook + Skill Guard for AI coding agents in Codex/GPT workflows: stop unrequested hashes, checksums, and task-scope creep.

JavaScript

Django-CRM

★ 2,436

Open Source CRM for Startups and enterprises. Django + SvelteKit · Self-hosted · Multi-tenant · Free forever

Python

wxtsky

CodeIsland

★ 2,436

Real-time AI coding agent status panel in your MacBook notch — live status, approvals & replies for 13 AI tools, with iPhone & Apple Watch companions

Swift

1sdv

TripStar

★ 2,434

旅途星辰 (TripStar)是一个创新的 AI 文旅智能体应用，旨在解决用户在规划旅行时面临的各种问题，为提供一站式旅游攻略而生。

Vue

AI-Hypercomputer

maxtext

★ 2,431

A simple, performant, and scalable Jax LLM. MaxText provides a library of high performance models to choose from, including Gemma, Llama, DeepSeek, Qwen, and Mistral.

Python

penecho

★ 2,430

Think with AI beyond the chat box. A shared canvas for handwriting, equations, diagrams, and spatial reasoning.

JavaScript

zenstory-ai

drama-skills

★ 2,427

开源 AI 短剧/漫剧创作 skill 合集：剧本、角色资产、分镜 storyboard、图片/视频提示词、审查，适配 Claude Code 与 Codex | Open-source AI short drama / micro-drama skills for Claude Code & Codex: script, assets, storyboard, image & video prompts, review. MIT.

Python