LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,089–2,112 of 4,627

Blueturboguy07

cue

★ 1,409

Open-source macOS AI copilot that floats over your screen, sees/hears your meetings, and stays hidden from screen shares. Cluely alternative, bring-your-own-key.

JavaScript

callstackincubator

ai

★ 1,409

On-device LLM execution in React Native with Vercel AI SDK compatibility

TypeScript

explosion

spacy-transformers

★ 1,408

🛸 Use pretrained transformers like BERT, XLNet and GPT-2 in spaCy

Python

tjboudreaux

cc-thinking-skills

★ 1,408

28 eval-informed mental models and critical-thinking skills for Claude Code, GitHub Copilot, Codex, Cursor, and other Agent Skills-compatible tools

JavaScript

cloudflare

nimbus

★ 1,406

Docs for humans and agents, built on Astro

TypeScript

awaescher

OllamaSharp

★ 1,405

The easiest way to use Ollama in .NET

threerocks

hand-drawn-styles

★ 1,405

Claude Code skill：把内容套进内置手绘画风配方,产出可直接复制的生图提示词。内置儿童涂色/极简线条/蜡笔童涂/吉卜力/小豆人涂鸦 5 种已验证画风。

Python

jsmastery-pro

skills

★ 1,403

Agentic Development skills behind the JS Mastery workflow

JavaScript

aws-samples

aws-genai-llm-chatbot

★ 1,398

A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI, Meta, AI21, Cohere, Mistral) using AWS CDK on AWS

TypeScript

designcomputer

mysql_mcp_server

★ 1,396

A Model Context Protocol (MCP) server that enables secure interaction with MySQL databases

Python

GradientHQ

parallax

★ 1,395

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

Python

explosion

spacy-llm

★ 1,394

🦙 Integrating LLMs into structured NLP pipelines

Python

GreenSheep01201

claw-empire

★ 1,394

Command Your AI Agent Empire from the CEO Desk — A local-first AI agent office simulator that orchestrates CLI, OAuth, and API-connected agents (Claude Code, Codex CLI, Gemini CLI, OpenCode, and more) as a virtual autonomous company.

TypeScript

m0n0x41d

haft

★ 1,393

Engineering decisions engine that know when they're stale. Frame, compare, decide — with evidence decay and parity enforcement. For Claude Code, Cursor, Gemini CLI, Codex and more.

wikieden

Freedom-To-Chatgpt-Claude-Agent

★ 1,393

ChatGPT调教指南|咒语指南|聊天提示词指南|学习指南

JavaScript

iAmCorey

Wake

★ 1,391

All your AI agent sessions in one place — browse, search, resume. Rust + GPUI.

Rust

aws-samples

generative-ai-use-cases

★ 1,388

Application implementation with business use cases for safely utilizing generative AI in business operations

TypeScript

morettt

my-neuro

★ 1,387

This project lets you create your own AI desktop companion with customizable characters and voice conversations that respond in just 1 second. Features include long-term memory, visual recognition, voice cloning and LLM training. Compatible with various Live2D customizations.

JavaScript

elirantutia

vibeyard

★ 1,386

The IDE built for AI coding agents.

TypeScript

justrach

codedb

★ 1,386

Zig code intelligence server and MCP toolset for AI agents. Fast tree, outline, symbol, search, read, edit, deps, snapshot, and remote GitHub repo queries.

Zig