AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

961–984 of 3,650
vllm-project

vllm-ascend

2,836

Community maintained hardware plugin for vLLM on Ascend

C++
totec448-spec

chat-on-steroids

2,835

Cross-platform local MCP capabilities for ChatGPT with Chrome integration, Goal, Compact & Resume, and durable multi-agent workflows.

TypeScript
cloudflare

skills

2,832

Skills for teaching agents how to build on Cloudflare.

Shell
datachain-ai

datachain

2,819

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

Python
sahibzada-allahyar

YC-Killer

2,816

A library of enterprise-grade AI agents designed to democratize artificial intelligence and provide free, open-source alternatives to overvalued Y Combinator startups.

TypeScript
confident-ai

deepteam

2,815

DeepTeam is a framework to red team LLMs and AI agents.

Python
oritera

Cairn

2,813

A AI general-purpose state-space search engine, validated first on autonomous penetration testing.

Python
huggingface

setfit

2,807

Efficient few-shot learning with Sentence Transformers

Jupyter Notebook
mll-lab-nu

RAGEN

2,803

Agent RL framework for LLM agents: multi-turn reinforcement learning with StarPO and reasoning-collapse diagnostics

Python
EvanBacon

serve-sim

2,798

The `npx serve` of Apple Simulators.

TypeScript
zinja-coder

jadx-ai-mcp

2,794

Plugin for JADX to integrate MCP server

Java
Vexa-ai

vexa

2,791

Open-source meeting transcription API for Google Meet, Microsoft Teams & Zoom. Auto-join bots, real-time WebSocket transcripts, MCP server for AI agents. Self-host or use hosted SaaS.

Python
git-ai-project

git-ai

2,790

A Git extension for tracking the AI-generated code in your repos

Rust
2,790

基于manga-image-translator 实现的开源漫画AI翻译桌面工具。支持日、韩、英文漫画自动处理,集成OpenAl、Gemini等多翻译引擎;实现OCR文字检测、原文擦除、AI翻译、图像修复、译文排版完整链路,自带可视化编辑器,支持自定义文本样式,一键部署开箱即用。

Python
2,789

Let AI agents use your real, logged-in browser without interrupting your work. CLI + extension for browser automation across any shell-capable AI agent.

TypeScript
brennercruvinel

CCPlugins

2,780

Best Claude Code framework that actually save time. Built by a dev tired of typing "please act like a senior engineer" in every conversation.

Python
opensolon

solon

2,777

Java enterprise application development framework for full scenario: Restrained, Efficient, Open, Ecologicalll!!! 700% higher concurrency 50% memory savings Startup is 10 times faster. Packing 90% smaller; Compatible with java8 ~ java25; Supports LTS. (Replaceable spring).

Java
2,771

471 plugins, 3,069 skills, 347 agents for Claude Code. Open-source marketplace at tonsofskills.com with the ccpi CLI package manager.

Python
control-theory

gonzo

2,767

Gonzo! The Go based TUI log analysis tool

Go
openlit

openlit

2,767

Open-source observability & evaluation platform for AI agents and coding agents. Trace LLMs, tools, prompts, costs & agent workflows with OpenTelemetry.

TypeScript
2,766

Paw Work - selection-first web agent for Chrome: select on the live page, describe the outcome, take away an editable office file. BYOK, sandboxed, no server.

JavaScript
zhizhuodemao

js-reverse-mcp

2,763

AI Agent-first JS 逆向 MCP Server:有头 Chrome 调试、断点、网络/WebSocket 分析、Patchright 反检测,可选 CloakBrowser。

TypeScript
alsk1992

CloddsBot

2,752

Open Source AI trading agent that operates autonomously across 1000+ markets - Polymarket, Kalshi, Binance, Hyperliquid, Solana DEXs, 5 EVM chains. Scans for edge, executes instantly, manages risk while you sleep. Agent commerce protocol for machine-to-machine payments. Self-hosted. Built on Claude.

TypeScript
CyberStrikeus

CyberStrike

2,752

Open-source AI-powered offensive security harness for automated penetration testing.

TypeScript