LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,081–1,104 of 3,650

roboflow

inference

★ 2,448

Turn any computer or edge device into a command center for your computer vision projects.

Python

FullAgent

fulling

★ 2,446

Fulling is an AI-powered Full-stack Engineer Agent. Built with Next.js, Claude, shadcn/ui, and PostgreSQL. Use kubernetes as infra.

TypeScript

milvus-io

bootcamp

★ 2,445

Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.

Jupyter Notebook

metarank

★ 2,442

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

Scala

samanhappy

mcphub

★ 2,442

Self-hosted MCP gateway and control plane for connecting, controlling, and operating MCP servers.

TypeScript

TorchIO-project

torchio

★ 2,442

Medical imaging processing for AI applications.

Python

ggozad

oterm

★ 2,440

the terminal client for LLMs

Python

hitsz-ids

synthetic-data-generator

★ 2,438

SDG is a specialized framework designed to generate high-quality structured tabular data.

Python

yctimlin

mcp_excalidraw

★ 2,436

MCP server and Claude Code skill for Excalidraw — programmatic canvas toolkit to create, edit, and export diagrams via AI agents with real-time canvas sync.

TypeScript

jackmpcollins

magentic

★ 2,425

Seamlessly integrate LLMs as Python functions

Python

prism-php

prism

★ 2,424

A unified interface for working with LLMs in Laravel

PHP

ScrapeCreators

social-media-research-skills

★ 2,424

AI agent skills for social media research. Outlier posts, comment mining, competitor teardowns, ad libraries & trends across TikTok, Instagram, YouTube, Reddit, X, LinkedIn & more. Powered by ScrapeCreators. Works with Claude Code, Cursor, Codex, Gemini CLI.

Python

CodeBoarding

★ 2,422

Interactive architecture diagrams for codebases

Python

AI-Hypercomputer

maxtext

★ 2,421

A simple, performant, and scalable Jax LLM. MaxText provides a library of high performance models to choose from, including Gemma, Llama, DeepSeek, Qwen, and Mistral.

Python

Django-CRM

★ 2,421

Open Source CRM for Startups and enterprises. Django + SvelteKit · Self-hosted · Multi-tenant · Free forever

Python

zurawiki

gptcommit

★ 2,419

A git prepare-commit-msg hook for authoring commit messages with LLMs.

Rust

LoRexxar

Kunlun-M

★ 2,414

KunLun-M — Open-source static code analysis for PHP, Nodejs/JavaScript, Python, Golang, Java and C/C++, with AST-based semantic scanning and one-click AI Agent integration (OpenClaw, Codex, Claude Code, Hermes, and more).

Python

e2b-dev

code-interpreter

★ 2,411

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Python

hydropix

TranslateBooksWithLLMs

★ 2,411

Translate full-length books and documents with Ollama, OpenAI-compatible, Gemini, Mistral, DeepSeek, Poe or OpenRouter. Preserves formatting. Resumes where you left off. No file size limits.

Python