LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

481–504 of 4,628

1weiho

open-slide

★ 8,133

A slide framework built for agents.

TypeScript

InternLM

lmdeploy

★ 8,098

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Python

YaoApp

yao

★ 8,062

✨ All your agents and workspaces in one place, on every device you own. Track tasks on a board, accessible from desktop, mobile, browser, or API. Self-hosted.

osaurus-ai

osaurus

★ 8,000

Own your AI. The native macOS harness for AI agents any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.

Swift

OpenCoworkAI

open-codesign

★ 7,976

Open-source Claude Design alternative. One-click import your Claude Code / Codex API key. Prompt → prototype / slides / PDF. Multi-model (Claude, GPT, Gemini, Kimi, GLM, Ollama). BYOK, local-first, MIT.

TypeScript

deeplethe

utopia

★ 7,974

World's first open-source enterprise world model.

Rust

tutao

tutanota

★ 7,967

Tuta is an email service with a strong focus on security and privacy that lets you encrypt emails, contacts and calendar entries on all your devices.

TypeScript

Blaizzy

mlx-audio

★ 7,962

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

Python

Tencent

BrowserSkill

★ 7,961

Let AI agents use your real, logged-in browser without interrupting your work. CLI + extension for browser automation across any shell-capable AI agent.

TypeScript

Upsonic

★ 7,956

Build autonomous AI agents in Python.

Python

evidentlyai

evidently

★ 7,923

Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Jupyter Notebook

ChenLiu-1996

figures4papers

★ 7,872

My Python scripts to make high-quality figures for publications in top AI conferences and journals.

Python

NirDiamant

Prompt_Engineering

★ 7,870

22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.

Jupyter Notebook

lucidrains

PaLM-rlhf-pytorch

★ 7,860

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Python

2FastLabs

agent-squad

★ 7,778

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

Swift

Azure-Samples

azure-search-openai-demo

★ 7,773

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

Python

HKUSTDial

Supervisor-Skills

★ 7,760

将博导十年科研经验炼化为可直接调用的 AI 技能。从 Idea 构思到论文投稿，你的 AI 科研副导师。

Python

ArvinLovegood

go-stock

★ 7,748

🦄🦄🦄AI赋能股票分析：AI加持的股票分析/选股工具。股票行情获取，AI热点资讯分析，AI资金/财务分析，涨跌报警推送。支持A股，港股，美股。支持市场整体/个股情绪分析，AI辅助选股等。数据全部保留在本地。支持DeepSeek，OpenAI， Ollama，LMStudio，AnythingLLM，硅基流动，火山方舟，阿里云百炼等平台或模型。