AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

313–336 of 3,650
microsoft

UFO

9,735

UFO³: Weaving the Digital Agent Galaxy

Python
mengxi-ream

read-frog

9,685

🐸 Read Frog - Language Learning & Translate | 🐸 陪读蛙 - 语言学习与翻译

TypeScript
apache

seatunnel

9,652

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

Java
xonsh

xonsh

9,643

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

Python
adongwanai

AgentGuide

9,631

https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习|数据合成

MDX
9,627

Autonomous AI development loop for Claude Code with intelligent exit detection

Shell
9,622

A straightforward method for training your LLM, from downloading data to generating text.

Python
9,593

This is MCP server for Claude that gives it terminal control, file system search and diff file editing capabilities

TypeScript
xorbitsai

inference

9,566

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Python
ntegrals

openbrowser

9,535

Let AI agents browse the web. An autonomous toolkit for browser-based AI agents.

TypeScript
oumi-ai

oumi

9,385

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

Python
droidrun

mobilerun

9,378

Automate your mobile devices with natural language commands - an LLM agnostic mobile Agent 🤖

Python
Thysrael

Horizon

9,360

Your own AI-powered news radar. Generates daily briefings in English & Chinese. | AI .

Python
thesysdev

openui

9,335

The Open Standard for Generative UI

TypeScript
coaidev

coai

9,308

🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

TypeScript
NVIDIA

garak

9,258

the LLM vulnerability scanner

Python
activeloopai

deeplake

9,235

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

C++
evilsocket

pwnagotchi

9,203

(⌐■_■) - Deep Reinforcement Learning instrumenting bettercap for WiFi pwning.

Python
BoundaryML

baml

9,180

The programming language for agents

Rust
9,173

智能闲鱼客服机器人系统:专为闲鱼平台打造的AI值守解决方案,实现闲鱼平台7×24小时自动化值守,支持多专家协同决策、智能议价和上下文感知对话。

Python
mark3labs

mcp-go

9,108

A Go implementation of the Model Context Protocol (MCP), enabling seamless integration between LLM applications and external data sources and tools.

Go
LearningCircuit

local-deep-research

9,094

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

Python
EvoMap

evolver

9,083

The GEP-powered self-evolving engine for AI agents. Auditable evolution with Genes, Capsules, and Events. | evomap.ai

JavaScript