AI channel
LLM apps

Open-source LLM apps and frameworks

This is the broadest group: chat interfaces, SDKs and frameworks, prompt and evaluation tools, and applications built on large language models. Many work with models from several providers, and some can run models on your own hardware.

How to choose

For anything you plan to ship, check three facts first: the licence, because some popular projects restrict commercial use; whether it supports the model provider you already use; and whether it is still maintained. The At a glance box on every project page answers the licence and maintenance questions from GitHub data.

Most-starred projects

1,849–1,872 of 3,650
agentlas-ai

Agentlas-OS

1,111

Agent OS: keep specialist agents in a hub, spin up a temporary orchestrator per task. Local-first, works with any model.

Python
mateaix

mateclaw

1,111

🤖 MateClaw — Your second brain with Multi-Agent Orchestration, MCP Protocol, Skills & Memory, Dream, and Multi-Channel Support. Built on Spring AI Alibaba.

Java
nobodywho-ooo

nobodywho

1,111

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Rust
berylliumsec

nebula

1,109

AI-powered penetration testing assistant for automating recon, note-taking, and vulnerability analysis.

Python
Continuum-AI-Corp

OrcaRouter-Lite

1,109

Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter

Python

The Simulink Agentic Toolkit gives your AI agent both the tools and the expertise to work effectively with Simulink and Model-Based Design.

HTML
Onelevenvy

flock

1,109

A desktop multi-agent harness built with Rust, Tauri, and React, powered by langgraph-rust.

Rust
TheAiSingularity

graphrag-local-ollama

1,108

Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction

Python
1,107

一款完全开源的微信公众号文章获取、RSS 订阅 API 服务,支持整号文章一键导出 7 种格式(Markdown/HTML/Word/PDF/EPUB/Excel/JSON)、IP 代理池反风控、MCP 接入各种 AI Agent 工具。

Python
1,105

A Dynamic Island-style command center for managing all your AI coding agents on macOS.

Swift
prehisle

relay-pulse

1,105

企业级 LLM 中转服务可用性监控系统,实时追踪服务状态并提供可视化仪表板。

Go
yeahhe365

Gemini-Nexus

1,104

Gemini Nexus 是一款面向浏览器场景的 AI 助手扩展,集成 Gemini Web、Gemini API 与 OpenAI 兼容接口,支持网页上下文、图像处理、工具调用和 MCP 浏览器控制。

JavaScript
EmbeddedLLM

JamAIBase

1,103

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Python
syrizelink

OpenFic

1,103

专为小说创作打造的跨平台、用户友好、AI Native 的一站式 Vibe Wrting 工具。A cross-platform, user-friendly, AI-native, all-in-one Vibe Writing tool designed specifically for novel wrting.

Python
bird-bench

BIRD-CRITIC-1

1,101

[NeurIPS 2025 Main] SWE-SQL: Illuminating LLM Pathways to Solve User SQL Issues in Real-World Applications

Python
ndif-team

nnsight

1,101

The nnsight package enables interpreting and manipulating the internals of deep learned models.

Python
1,100

A unified cross-platform AI client supporting seamless transitions between standard cloud APIs and on-device, offline execution of custom and uncensored language models.

C++
Dicklesworthstone

beads_rust

1,099

Fast Rust port of Steve Yegge's beads: local-first, non-invasive issue tracker storing tasks in SQLite with JSONL export for git collaboration

Rust
lasgroup

SDPO

1,099

Reinforcement Learning via Self-Distillation (SDPO)

Python
1,098

Local AI Agent running on Raspberry Pi

Python
Toni-SM

skrl

1,097

Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments

Python

Agent-ready DevOps, security, infrastructure, and compliance knowledge base with 80+ skills across Kubernetes, Terraform, AWS/Azure/GCP, AI platform operations, container hardening, SOC2/ISO27001, and incident response—plus ready-to-run scripts, templates, and playbooks for SRE, platform, and security teams.

Shell
1,093

仕事の日本語を、読みやすくわかりやすく書く・直すための Agent Skill です。

Python