AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

457–480 of 4,628
firerpa

lamda

★ 8,493

Android Full-Stack Device Control Platform: WebRTC/H.264 remote desktop, UI/OCR/image-matching automation, one-click MITM, built-in Frida, proxy/VPN/frp/P2P networking, MCP/Agent, 160+ APIs, designed for multi-device clusters and engineered deployments.

Python
bitsandbytes-foundation

bitsandbytes

★ 8,484

Accessible large language models via k-bit quantization for PyTorch.

Python
bytedance

flowgram.ai

★ 8,478

FlowGram is an extensible workflow development framework with built-in canvas, form, variable, and materials that helps developers build AI workflow platforms faster and simpler.

TypeScript
strands-agents

harness-sdk

★ 8,411

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

Python
withastro

flue

★ 8,407

The sandbox agent framework.

TypeScript
qualcomm

GenieX

★ 8,406

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Rust
google-labs-code

stitch-skills

★ 8,405

A library of Agent Skills designed to work with the Stitch MCP server. Each skill follows the Agent Skills open standard, for compatibility with coding agents such as Antigravity, Gemini CLI, Claude Code, Cursor.

TypeScript
idosal

git-mcp

★ 8,402

Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project

TypeScript
automazeio

ccpm

★ 8,384

Project management skill system for Agents that uses GitHub Issues and Git worktrees for parallel agent execution.

Shell
boson-ai

higgs-audio

★ 8,365

Text-audio foundation model from Boson AI

Python
Lake1059

FFmpegFreeUI

★ 8,339

3FUI 是 ffmpeg 在 Windows 上的轻度专业交互外壳,收录大量参数,界面美观,交互友好。此项目面向国内使用环境,让普通人也能够轻松压制视频和转换格式。

Visual Basic .NET
zilliztech

deep-searcher

★ 8,291

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

Python
★ 8,257

🚀 The best real-time interactive AI avatar(digital human) with on-premise deployment and <1.5 s latency.

C++
jnMetaCode

superpowers-zh

★ 8,248

🦸 AI 编程超能力 · 中文增强版 — superpowers(250k+ ⭐)完整汉化 + 4 个中国原创 skills,让 Claude Code / Copilot CLI / Hermes Agent / Cursor / Windsurf / Kiro / Gemini CLI / Qoder 等 26 款 AI 编程工具真正会干活

JavaScript
AAswordman

Operit

★ 8,228

The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent

Kotlin
OpenDCAI

DataFlow

★ 8,211

Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Python
zilliztech

GPTCache

★ 8,206

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

Python
k8sgpt-ai

k8sgpt

★ 8,205

Giving Kubernetes Superpowers to everyone

Go
chaitanyagiri

munder-difflin

★ 8,202

A local multi-agent harness that works with your existing Claude Code, Codex subscriptions, allows you to run an office of agents

TypeScript
mattpocock

sandcastle

★ 8,202

Orchestrate sandboxed coding agents in TypeScript with sandcastle.run()

TypeScript
ai-dynamo

dynamo

★ 8,190

A Datacenter Scale Distributed Inference Serving Framework

Rust
GetStream

Vision-Agents

★ 8,141

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.

Python
maximhq

bifrost

★ 8,140

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Go
★ 8,135

Autonomous experiment loop extension for pi

TypeScript