LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

193–216 of 4,628

mlc-ai

web-llm

★ 19,208

High-performance In-browser LLM Inference Engine

TypeScript

stas00

ml-engineering

★ 19,065

Machine Learning Engineering Open Book

Python

ymcui

Chinese-LLaMA-Alpaca

★ 18,938

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

Python

hemanth

functional-programming-jargon

★ 18,722

Jargon from the functional programming world in simple terms!

JavaScript

op7418

Humanizer-zh

★ 18,649

Humanizer 的汉化版本，Claude Code Skills，旨在消除文本中 AI 生成的痕迹。

Python

metainternal

llama-cookbook

★ 18,557

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

Jupyter Notebook

jlcodes99

cockpit-tools

★ 18,514

🚀 通用 AI IDE 账号管理工具：支持 Antigravity / Codex / GitHub Copilot / Windsurf / Kiro / Cursor / Gemini-cli / CodeBuddy，多账号切换、配额监控、自动唤醒与多开实例管理。 🚀 Universal AI IDE account manager for Antigravity / Codex / GitHub Copilot / Windsurf / Kiro / Cursor / Gemini-cli / CodeBuddy, with multi-account switching, quota monitoring, wake-up automation, and multi-insta

Rust

Huanshere

VideoLingo

★ 18,508

Netflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team | Netflix级字幕切割、翻译、对齐、甚至加上配音，一键全自动视频搬运AI字幕组

Python

confident-ai

deepeval

★ 18,313

The LLM Evaluation Framework

Python

emcie-co

parlant

★ 18,294

Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

Python

arc53

DocsGPT

★ 18,271

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

Python

langchain-ai

langchainjs

★ 18,240

The agent engineering platform

TypeScript

xming521

WeClone

★ 18,229

🚀 One-stop solution for creating your AI twin from chat history 💡 Fine-tune LLMs with your chat logs to capture your unique style, then bind to a chatbot to bring your digital self to life.

Python

gastownhall

gastown

★ 18,220

Gas Town - multi-agent workspace manager

RightNow-AI

openfang

★ 18,206

Open-source Agent Operating System. OpenFang The Agent Operating System Open-source Agent OS built in Rust.

Rust

browser-use

browser-harness

★ 18,114

Browser Harness | Self-healing harness that enables LLMs to complete any task.

Python

gnachman

iTerm2

★ 18,104

iTerm2 is a terminal emulator for Mac OS X that does amazing things.

Objective-C

muratcankoylan

Agent-Skills-for-Context-Engineering

★ 18,039

A comprehensive collection of Agent Skills for context engineering, multi-agent architectures, and production agent systems. Use when building, optimizing, or debugging agent systems that require effective context management.

Python

langbot-app

LangBot

★ 17,978

Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow

Python

rowboatlabs

rowboat

★ 17,909

Open-source AI coworker, with memory

TypeScript

Canner

WrenAI

★ 17,793

GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.

Python