LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

2,017–2,040 of 3,650

alpacahq

alpaca-mcp-server

★ 963

Alpaca’s official MCP Server lets you trade stocks, ETFs, crypto, and options, run data analysis, and build strategies in plain English directly from your favorite LLM tools and IDEs

Python

e10nMa2k

cc-mini

★ 963

Ultra-light Harness scaffolding for AI agents, a mini version of claude code

Python

helicalinsight

★ 963

Free, open source BI platform with AI conversational analytics (BYO-LLM), pixel-perfect paginated reports, interactive dashboards, SSO, embedding, multi-tenancy & row-level security. Every feature free in Community Edition. Self-hosted, Docker-ready

JavaScript

data-prep-kit

★ 962

Open source project for data preparation for GenAI applications

HTML

runesleo

x-reader

★ 962

Universal content reader MCP Server for 10+ platforms

Python

stackql

★ 962

Query, provision and operate Cloud, SaaS, API and Model Context Protocol (MCP) resources through a unified SQL-based framework for humans and AI agents.

kardolus

chatgpt-cli

★ 961

ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more, with features like streaming, interactive chat, prompt files, image/audio I/O, MCP tool calls, and an experimental agent mode for safe, multi-step automation.

alesaccoia

VoiceStreamAI

★ 960

Near-Realtime audio transcription using self-hosted Whisper and WebSocket in Python/JS

Python

cdxiaodong

cain-agent

★ 960

Real-world AI penetration testing engineer for authorized assessments — built-in cloud module covering AWS/Azure/GCP + Aliyun/Tencent/Huawei clouds. Built on Claude Agent SDK

Python

noahgsolomon

brainrot.js

★ 960

Text to video generator in the brainrot form. Learn about any topic from your favorite personalities 😼.

Python

beltromatti

get-it

★ 959

Read it. See it. Get it. Built at GDG AI Hack Milan 2026 for "Learn Different" track.

JavaScript

komal-SkyNET

claude-skill-homeassistant

★ 959

Claude Code skill to supercharge and manage all Home Assistant workflows

psi-oss

get-physics-done

★ 959

The first open-source agentic AI physicist, by Physical Superintelligence PBC (PSI).

Python

harlan-zw

mdream

★ 958

☁️ The fastest HTML to markdown convertor on GitHub. Optimized for LLMs and supports streaming.

TypeScript

s-kostyaev

ellama

★ 958

Work with local and cloud LLMs from Emacs.

Emacs Lisp

NVIDIA-NeMo

Automodel

★ 957

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

Raudaschl

rag-fusion

★ 957

RAG-Fusion: multi-query generation + Reciprocal Rank Fusion for better retrieval-augmented generation. Includes evaluation harness with NFCorpus/BEIR.

Python

BinWang28

audio-ai-hub

★ 956

The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.

Python

d0r1h

ML-University

★ 955

Machine Learning Open Source University

jlrouzies-fr

DLSS5-Feeder

★ 955

DLSS 5 neural rendering in D3D11/D12/Vulkan games that ship without any DLSS — feeds a synthetic DLAA contract (ReShade depth + motion vectors) to the DLSS 5 add-on via a private D3D12 device.

C++