LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,681–1,704 of 4,627

numtide

llm-agents.nix

★ 2,037

Nix packages for AI coding agents and development tools. Automatically updated daily.

Nix

cfregly

ai-performance-engineering

★ 2,031

Code, labs, and resources for O'Reilly AI Systems Performance Engineering: GPU optimization, distributed training, inference scaling, and full-stack tuning.

Python

Doorman11991

smallcode

★ 2,028

AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model.

JavaScript

akdeb

ElatoAI

★ 2,025

Realtime Voice AI with 100+ Models on Arduino ESP32 with Secure Websockets and Edge Functions for AI Companions, and Devices

TypeScript

memorax-ai

memorax-code

★ 2,023

A memory plugin for AI coding that turns engineering experience, repository knowledge, and your way of working into memory that remains useful in future tasks.

JavaScript

jimmc414

onefilellm

★ 2,021

Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion

Python

msoedov

agentic_security

★ 2,017

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

Python

nottelabs

notte

★ 2,010

Cloud browser infrastructure and web automation platform for your AI and coding agents

Python

Andrew-Jang

RAGHub

★ 2,008

A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evolving RAG ecosystem.

pchalasani

claude-code-tools

★ 2,008

Practical productivity tools for Claude Code, Codex-CLI, and similar CLI coding agents.

Python

open-compress

claw-compactor

★ 2,007

14-stage Fusion Pipeline for LLM token compression — reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.

Python

shcherbak-ai

contextgem

★ 2,007

ContextGem: Effortless LLM extraction from documents

Python

MemTensor

memmy-agent

★ 2,004

🍙 A personal AI agent & local memory hub for all AI agents, gives every AI one shared, fully controlled memory and persistent context — all AI remember the same you. Now supports Claude Code, Codex, OpenClaw and Hermes Agent etc.

TypeScript

patterns-ai-core

langchainrb

★ 1,999

Build LLM-powered applications in Ruby

Ruby

win4r

AISuperDomain

★ 1,999

Aila(AI超元域): The premier AI integration tool for Windows, macOS, and Android. Ask once, get answers from 10+ AIs like ChatGPT, Gemini, Claude3, Copilot, Poe, perplexity and more. Features customizable AI and prompts.

Dryxio

reagent

★ 1,998

Reconstruct and validate C/C++ code from compiled programs with AI.

Python

AntigmaLabs

ante

★ 1,995

Ghost in your shell. Ante is a self-contained agent harness with a highly optimized core. It works like Claude Code or Codex, with none of their dependencies or model constraints.

Rust

nhaouari

obsidian-textgenerator-plugin

★ 1,991

Text Generator is a versatile plugin for Obsidian that allows you to generate text content using various AI providers, including OpenAI, Anthropic, Google and local models.

TypeScript

tsingyuai

growth-lab

★ 1,991

An end-to-end growth tool that understands the product, fetch the data it needs, researches the market, executes campaigns, and reviews results to improve the next round of growth. 从代码到市场的开源端到端增长工具。理解产品、接入信息渠道、研究市场、执行增长行动，并基于真实数据自我改进。

Python

mudler

LocalAGI

★ 1,988

LocalAGI is a powerful, self-hostable AI Agent platform designed for maximum privacy and flexibility. A complete drop-in replacement for OpenAI's Responses APIs with advanced agentic capabilities. No clouds. Local AI that works on consumer-grade hardware (CPU and GPU).