LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

409–432 of 3,650

datawhalechina

fun-rec

★ 7,344

推荐系统入门教程，在线阅读地址：https://datawhalechina.github.io/fun-rec/

Python

zhouxiaoka

autoclip

★ 7,342

AutoClip : AI-powered video clipping and highlight generation · 一款智能高光提取与剪辑的二创工具

Python

luhengshiwo

LLMForEverybody

★ 7,335

每个人都能看懂的大模型知识分享，LLMs春/秋招大模型面试前必看，让你和面试官侃侃而谈

Jupyter Notebook

AgentDeskAI

browser-tools-mcp

★ 7,319

Monitor browser logs directly from Cursor and other MCP compatible IDEs.

TypeScript

DataTalksClub

llm-zoomcamp

★ 7,297

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base. Register here 👇🏼

Jupyter Notebook

strands-agents

harness-sdk

★ 7,241

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

Python

Zipstack

unstract

★ 7,239

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

Python

zai-org

GLM-5

★ 7,190

GLM-5: From Vibe Coding to Agentic Engineering

plastic-labs

honcho

★ 7,180

Memory library for building stateful agents

Python

kyegomez

swarms

★ 7,175

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

Python

NVIDIA-NeMo

Guardrails

★ 7,145

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Python

JerryZLiu

Dayflow

★ 7,125

The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.

Swift

ymcui

Chinese-LLaMA-Alpaca-2

★ 7,119

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Python

lance-format

lance

★ 7,076

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust

katanemo

plano

★ 7,055

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Rust

datajuicer

data-juicer

★ 7,047

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Python

tw93

Waza

★ 7,028

🥷 Engineering habits you already know, turned into skills Claude can run.

Python

lintsinghua

DeepAudit

★ 7,023

DeepAudit is an open-source multi-agent code security platform for vulnerability research, including auto PoC verification and report generation, with Ollama private deployment support.

Python

grab

cursor-talk-to-figma-mcp

★ 7,022

TalkToFigma: MCP integration between AI Agent (Cursor, Claude Code, Codex) and Figma, allowing Agentic AI to communicate with Figma for reading designs and modifying them programmatically.

JavaScript