LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,737–2,760 of 4,121

iamzulx

crypto-rag

★ 653

Asisten crypto berbahasa Indonesia: RAG pengetahuan 267 topik + data pasar realtime (6 bursa, WebSocket, derivatif, on-chain, TVL, DeFi) + tool-calling agent + LLM synthesis

Python

veedstudio

open-edit

★ 653

Open-source, agent-driven editing pipeline: create subtitles, motion graphics, slides, edit and render videos.

TypeScript

NadirRouter

NadirClaw

★ 652

Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

Python

V-know

ChatGPT-Telegram-Bot

★ 652

A Telegram bot with a silky smooth AI experience. UI enabled.

Python

zinja-coder

apktool-mcp-server

★ 652

A MCP Server for APK Tool (Part of Android Reverse Engineering MCP Suites)

Python

agentscope-ai

agentscope-studio

★ 651

A development-oriented visualization toolkit

TypeScript

momozi1996

momo-code

★ 651

MOMO CODE — AI coding agent that evolves with you

TypeScript

universal-tool-calling-protocol

python-utcp

★ 651

Official python implementation of UTCP. UTCP is an open standard that lets AI agents call any API directly, without extra middleware.

Python

Varnan-Tech

opendirectory

★ 651

AI Agent Skills built for Founders who hate Marketing

Python

truffle-ai

dexto

★ 650

Agent harness and tookit for building AI agents and agentic applications. CLI and SDKs included

TypeScript

chainbase-labs

Agentkey

★ 649

Connect your AI agent to the world — Web search, Social media, Crypto & On-chain data. One plugin, zero extra config.

Shell

iAmCorey

kooky

★ 649

A minimal modern terminal for AI coding experience — Sidebar workspaces; horizontal / vertical split panes; one-click agent launch; per-agent activity readout; live workspace state with one-click Node and branch switching.

Swift

judahpaul16

gpt-home

★ 649

ChatGPT at home! A better alternative to commercial smart home assistants, built on the Raspberry Pi using LiteLLM and LangGraph.

Python

EverMind-AI

SkillCorpus

★ 648

Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

Python

witchan

ios-mcp

★ 648

iOS MCP: MCP management tool for jailbroken iPhones, enabling developers and AI agents to inspect and control devices.

Objective-C

bidyut10

opensourceui

★ 647

Opensource UI: Free, open-source, and production-ready components for React and Next.js. Powered by TypeScript, Tailwind CSS, and lucide icons

TypeScript

h5i-dev

h5i

★ 647

Fast, security-first headless browser for AI agents. Built for automation, red teaming, web testing, and scraping, with direct HTTP traffic control and auditable sessions. Pure Rust, no Chromium or V8.

Rust

prajwalshettydev

UnrealGenAISupport

★ 647

Unreal Engine plugin for LLM/GenAI models & MCP UE5 server. OpenAI GPT-5, Deepseek R1, Claude Opus/Sonnet, Gemini 3, Grok 4, Alibaba Qwen, Kimi, ElevenLabs TTS, Inworld, OpenRouter, Groq, GLM, Ollama, Local, Meshy, Tripo, Hunyuan3D, Rodin, fal, Dashscope, Seedream. NPC AI, agentic, chat, 3D gen, TTS, multimodal, image gen. UnrealMCP/UnrealClaude

C++

xiaohuailabs

xiaohu-video-translate

★ 647

对 AI 说一句话，把外语视频自动配上中文字幕 —— 下载/转写/翻译/润色/烧录一条龙，全程本地，转写零 API 费

Python

myccarl

ai-shortVideo-pipeline

★ 646

End-to-end AI short-video production pipeline. FastAPI orchestration + Spring Boot gateway with multi-model failover, circuit breaker, metering, and full-stack observability. AI quality gating: prompt anchoring, CLIP consistency, AV sync auto-rescue.

Python

zhongyu09

openchatbi

★ 646

OpenChatBI is an intelligent chat-based BI tool powered by large language models, designed to help users query, analyze, and visualize data through natural language conversations. It uses LangGraph and LangChain to build chat agent and workflows that support natural language to SQL conversion and data analysis.

Python