AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

889–912 of 4,628
openai

harmony

★ 4,509

Renderer for the harmony response format to be used with gpt-oss

Rust
pydantic

logfire

★ 4,500

AI observability platform for production LLM and agent systems.

Python
solidSpoon

DashPlayer

★ 4,490

为英语学习者量身打造的视频播放器，助你通过观看视频、沉浸真实语境，轻松提升英语水平。#美剧 #播放器 #听力

TypeScript
zjunlp

DeepKE

★ 4,484

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

Python
★ 4,483

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

Python
microsoft

LMOps

★ 4,475

General technology for enabling AI capabilities w/ LLMs and MLLMs

Python
★ 4,471

CISO Assistant is a one-stop-shop GRC platform for Risk Management, AppSec, Compliance & Audit, TPRM, BIA, Privacy, and Reporting. It supports 200+ global frameworks with automatic control mapping, including ISO 27001, NIST CSF, SOC 2, CIS, PCI DSS, NIS2, DORA, GDPR, HIPAA, CMMC, and more.

Python
mosaicml

llm-foundry

★ 4,449

LLM training code for Databricks foundation models

Python
★ 4,444

Community plugin marketplace for Claude Cowork and Claude Code. Read-only mirror — submit plugins at clau.de/plugin-directory-submission.

Python
EvolvingLMMs-Lab

lmms-eval

★ 4,440

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Python
zgsm-ai

costrict

★ 4,440

Costrict - strict AI coder for enterprises, quality first, including AI Agent, AI CodeReview, AI Completion.

TypeScript
gptme

gptme

★ 4,439

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

Python
Anakin-Inc

anakin

★ 4,432

Open-source web scraping API. Turn any website into clean markdown or structured JSON. Anti-detect browser, proxy auto-selection, self-hosted. One command: make up

Go
cs-lazy-tools

ChatGPT-On-CS

★ 4,424

拼多多、千牛、抖店 AI 客服机器人：自动回复客户咨询、商品答疑、售后申诉处理，支持微信、小红书、京东、抖音、B站、微博等多平台统一接待；可接入 DeepSeek / 通义千问 等大模型，支持自有知识库定制。

TypeScript
★ 4,423

One delightful Ruby framework for every major AI provider. Build AI agents, chatbots, RAG apps, and multimodal workflows in beautiful, expressive code.

Ruby
open-compass

VLMEvalKit

★ 4,422

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Python
zhukunpenglinyutong

desktop-cc-gui

★ 4,416

Multi-engine AI coding desktop client (Tauri). Claude Code, Codex, Gemini, OpenCode, DeepSeek Harness and more in one GUI.

TypeScript
meta-llama

PurpleLlama

★ 4,411

Set of tools to assess and improve LLM security.

Python
decodingai-magazine

llm-twin-course

★ 4,391

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴

Python
★ 4,389

🤖 A visualization mcp & skills contains 25+ visual charts using @antvis. Using for chart generation and data analysis.

TypeScript
datawhalechina

llms-from-scratch-cn

★ 4,387

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

Jupyter Notebook
open-webui

mcpo

★ 4,387

A simple, secure MCP-to-OpenAPI proxy server

Python
IvanMurzak

Unity-MCP

★ 4,372

AI Skills, MCP Tools, and CLI for Unity Engine. Full AI develop and test loop. Use cli for quick setup. Efficient token usage, advanced tools. Any C# method may be turned into a tool by a single line. Works with Claude Code, Gemini, Copilot, Cursor and any other absolutely for free.

C#