LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

3,409–3,432 of 4,152

NVIDIA-BioNeMo

bionemo-agent-toolkit

★ 461

Turn any agent into a life science expert with NVIDIA BioNeMo skills.

Python

simonw

llm-gemini

★ 461

LLM plugin to access Google's Gemini family of models

Python

trotsky1997

OpenFugu

★ 461

Open reimplementation of Sakana Fugu — the 'one model to command them all' LLM orchestrator. Read → run → train → serve.

Python

worldliberty

agentpay-sdk

★ 461

An open SDK for agentic payments. Let AI agents make payments, hold funds, and move money across chains with policy enforcement and human approval built in.

Rust

YeJe-cpu

talk-to-fengge

★ 461

Talk to 峰哥 — 克隆任何人的声音和性格，实时语音对话，工程延迟 < 1 秒 | Clone anyone's voice & personality for real-time conversation. < 1s engineering latency.

Python

BoardUI

boardui

★ 460

React design system for agentic interfaces. Every free BoardUI component as source, with a working AI chat app on your own model key as the homepage.

TypeScript

iKora128

stop-ai-slop-jp

★ 460

日本語の文章からAI臭を取り除く Claude Skill

Laumss

loominary

★ 460

Conversations shouldn't just live in a scroll bar. Loominary gives your Claude and SillyTavern conversations a home — a local archive of every conversation, yours to keep. Coming soon...

JavaScript

wanshuiyin

HERO-Anti-OverDefense

★ 460

HERO = Hashing · Edge cases · Rubrics · Overbuild — the four shapes coding agents over-defend in. A paste-in contract that stops them. Works with Claude Code, Codex, Antigravity, Cursor, Copilot, Windsurf, Gemini CLI.

Markdown

cablate

mcp-google-map

★ 459

A powerful Model Context Protocol (MCP) server providing comprehensive Google Maps API integration with LLM processing capabilities.

TypeScript

guidewire-oss

fern-platform

★ 459

Unified test intelligence platform with multi-format ingestion, real-time analytics, and AI-powered insights via LLM integration

juyterman1000

entroly

★ 459

Cut AI context cost without trusting the compressor. Every reduction is reversible, byte-exact recoverable, and carries an auditable receipt. Local-first, works through proxy, MCP, SDK, or agent wrapper.

Python

Tswoen

Paper-Agent

★ 459

Paper-Agent 是一个面向科研人员和学生的智能论文检索与调研工具。项目基于多智能体协作架构（LangGraph），通过自然语言处理（NLP）、自动化搜索，帮助用户高效查找学术论文、分析文献内容，并进行论文调研。Paper-Agent 支持多平台集成、关键词搜索、自动分析、论文调研，提升了学术研究的效率。适用于论文写作、学术调研、科研项目管理等多种场景，是学术调研的理想助手。

Python

Asymptote-Labs

agent-beacon

★ 458

Agent Beacon is the world's first open-source telemetry layer for AI agents wherever they run: locally, in CI, in the browser, or in the cloud.

bigsk1

voice-chat-ai

★ 458

🎙️ Speak with AI - Run locally using Ollama, OpenAI, Anthropic or xAI - Speech uses SparkTTS, OpenAI, ElevenLabs, Kokoro, Typecast or xAI

Python

Rivflyyy

HappyTorch

★ 458

A PyTorch coding practice platform — covering LLM, Diffusion, PEFT, and more A friendly environment to help you deeply understand deep learning components through hands-on practice. Like LeetCode, but for tensors. Self-hosted. Supports both Jupyter and Web interfaces.

Jupyter Notebook

statelyai

agent

★ 458

Create state-machine-powered LLM agents using XState

TypeScript

AI272

speaker

★ 457

Speaker is a Codex skill project for academic presentations: read real.pptx, combine text extraction, PPTX structure parsing, page-by-page rendering, OCR, and visual review to generate page-by-page speaker notes, and write a clean version of the lecture into the PowerPoint comment area.

Python

kyky2347

ALTA

★ 457

Autonomous LLM Trading Asterism — a research-only multi-agent trading platform with evidence-first research, an auditable console, Shadow simulation and explicitly authorized broker execution.

Python

MinaSaad1

pbi-cli

★ 457

Power BI CLI - semantic models (.NET TOM) and PBIR reports for token-efficient AI agent usage, built for Claude Code

Python

OnlyTerp

opengrok

★ 457

Run any model in Grok Bot — one-command setup, model picker UI, evidence-based provider wire maps, and an update-proof doctor. Not farming you, arming you.

JavaScript